Jul 10 05:39:46 devstack cinder-volume[76204]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 05:39:46 devstack cinder-volume[76204]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 05:39:46 devstack cinder-volume[76204]: we strongly recommend against using it for new projects. Jul 10 05:39:46 devstack cinder-volume[76204]: If you are already using Eventlet, we recommend migrating to a different Jul 10 05:39:46 devstack cinder-volume[76204]: framework. For more detail see Jul 10 05:39:46 devstack cinder-volume[76204]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 05:39:46 devstack cinder-volume[76204]: import eventlet # noqa Jul 10 05:39:49 devstack cinder-volume[76204]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:39:49 devstack cinder-volume[76204]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:39:49 devstack cinder-volume[76204]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:39:50 devstack cinder-volume[76204]: INFO dbcounter [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Registered counter for database cinder Jul 10 05:39:50 devstack cinder-volume[76204]: DEBUG oslo_db.sqlalchemy.engines [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:39:50 devstack cinder-volume[76204]: DEBUG dbcounter [-] [76204] Writer thread running {{(pid=76204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 05:39:50 devstack cinder-volume[76204]: INFO cinder.rpc [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 05:39:50 devstack cinder-volume[76204]: INFO cinder.rpc [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 05:39:50 devstack cinder-volume[76204]: DEBUG oslo_db.sqlalchemy.engines [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:39:50 devstack cinder-volume[76204]: INFO cinder.volume.manager [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Determined volume DB was empty at startup. Jul 10 05:39:50 devstack cinder-volume[76204]: DEBUG cinder.volume.manager [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76204) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 05:39:50 devstack cinder-volume[76204]: INFO cinder.volume.manager [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 05:39:50 devstack cinder-volume[76204]: WARNING stevedore.named [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 05:39:50 devstack cinder-volume[76204]: WARNING castellan.key_manager [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:39:50 devstack cinder-volume[76204]: WARNING cinder.keymgr.conf_key_mgr [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:39:50 devstack cinder-volume[76204]: DEBUG cinder.volume.drivers.lvm [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76204) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 05:39:50 devstack cinder-volume[76204]: DEBUG oslo_concurrency.processutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_concurrency.processutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] CMD "cinder-rtstool verify" returned: 0 in 0.444s {{(pid=76204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_db.sqlalchemy.engines [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:39:51 devstack cinder-volume[76204]: INFO cinder.rpc [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 05:39:51 devstack cinder-volume[76204]: INFO cinder.rpc [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 05:39:51 devstack cinder-volume[76204]: WARNING stevedore.named [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 05:39:51 devstack cinder-volume[76204]: WARNING castellan.key_manager [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:39:51 devstack cinder-volume[76204]: INFO cinder.volume.manager [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_db.sqlalchemy.engines [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:39:51 devstack cinder-volume[76204]: INFO oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Starting 1 workers Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Started child 76364 {{(pid=76204) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Full set of CONF: {{(pid=76204) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] ******************************************************************************** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Configuration options gathered from: {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] ================================================================================ {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] allow_availability_zone_fallback = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] allow_compression_on_image_upload = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] allowed_direct_url_schemes = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] api_rate_limit = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] auth_strategy = keystone {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76364]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] az_cache_duration = 3600 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_availability_zone = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_host = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_stats_polling_interval = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backup_api_class = cinder.backup.api.API {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backup_name_template = backup-%s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backup_use_same_host = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backup_use_temp_snapshot = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] chap_password = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] chap_username = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_internal_tenant_project_id = 864921a4c8794f4c8547c1739fc25be8 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_internal_tenant_user_id = 13c34bf95c7e44189bcea0354764ca34 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cloned_volume_same_az = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cluster = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] compression_format = gzip {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] compute_api_class = cinder.compute.nova.API {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] config_dir = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] config_source = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] control_exchange = openstack {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] debug = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] default_availability_zone = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] default_group_type = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] default_volume_type = lvmdriver-1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] disk_geometry = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] driver_client_cert = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] driver_client_cert_key = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] driver_data_namespace = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] driver_ssl_cert_path = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] driver_ssl_cert_verify = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] driver_use_ssl = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] enable_force_upload = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] enable_new_services = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] enable_unsupported_driver = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] enabled_backends = ['lvmdriver-1'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] enforce_multipath_for_image_xfer = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] filter_function = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_api_insecure = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_api_servers = ['http://192.168.122.59/image'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_api_ssl_compression = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_ca_certificates_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_catalog_info = image:glance:publicURL {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_num_retries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance_request_timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] goodness_function = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] graceful_shutdown_timeout = 5 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] group_api_class = cinder.group.api.API {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] host = devstack {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_compress_on_upload = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_conversion_address_space_limit = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_conversion_cpu_limit = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_conversion_disable = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_upload_use_cinder_backend = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_upload_use_internal_tenant = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_volume_cache_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_volume_cache_max_count = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] image_volume_cache_max_size_gb = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] init_host_max_objects_retrieval = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] instance_format = [instance: %(uuid)s] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] iscsi_target_flags = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] iscsi_write_cache = on {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] iser_helper = tgtadm {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] iser_ip_address = 192.168.122.59 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] iser_port = 3260 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_color = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_config_append = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_dir = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_options = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_rotate_interval = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_rotate_interval_type = days {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] log_rotation_type = none {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] max_age = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] max_logfile_count = 30 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] max_logfile_size_mb = 200 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] max_over_subscription_ratio = 20.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] message_reap_interval = 86400 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] message_ttl = 2592000 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] migration_create_volume_timeout_secs = 300 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] monkey_patch = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] monkey_patch_modules = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] my_ip = 192.168.122.59 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] no_snapshot_gb_quota = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] num_iser_scan_tries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] num_shell_tries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] num_volume_device_scan_tries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] nvmeof_conn_info_version = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] nvmet_ns_id = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] nvmet_port_id = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_max_limit = 1000 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_volume_ext_list = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_volume_listen = 0.0.0.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_volume_listen_port = 8776 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_volume_use_ssl = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] osapi_volume_workers = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] per_volume_size_limit = -1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] periodic_fuzzy_delay = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] periodic_interval = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] project_id_regex = [0-9a-f\-]+ {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] public_endpoint = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] publish_errors = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_backup_gigabytes = 1000 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_backups = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_gigabytes = 1000 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_groups = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_snapshots = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] quota_volumes = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] rate_limit_burst = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] rate_limit_except_level = CRITICAL {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] rate_limit_interval = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] reinit_driver_count = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] replication_device = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] report_discard_supported = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] report_interval = 120 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] reservation_clean_interval = 86400 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] reservation_expire = 86400 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] reserved_image_namespaces = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] reserved_percentage = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] rpc_response_timeout = 120 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] run_external_periodic_tasks = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] scst_target_driver = iscsi {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] scst_target_iqn_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_down_time = 720 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] shell_completion = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] snapshot_name_template = snapshot-%s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] snapshot_same_host = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] split_loggers = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] state_path = /opt/stack/data/cinder {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] storage_availability_zone = nova {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] storage_protocol = iSCSI {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] syslog_log_facility = LOG_USER {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] target_helper = lioadm {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] target_ip_address = 192.168.122.59 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] target_port = 3260 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] target_protocol = iscsi {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] target_secondary_ip_addresses = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] trace_flags = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] transfer_api_class = cinder.transfer.api.API {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] transport_url = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] until_refresh = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_chap_auth = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_default_quota_class = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_journal = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_json = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_multipath_for_image_xfer = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_stderr = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] use_syslog = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] verify_glance_signatures = enabled {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_api_class = cinder.volume.api.API {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_backend_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_clear = zero {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_clear_ionice = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_clear_size = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_copy_bps_limit = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_dd_blocksize = 1M {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_name_template = volume-%s {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_service_inithost_offload = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volume_usage_audit_period = month {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] zoning_mode = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_concurrency.disable_process_locking = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.auth_section = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.auth_type = password {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.auth_version = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.cache = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.delay_auth_decision = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.http_connect_timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.include_service_catalog = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.insecure = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.interface = public {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_password = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcache_username = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.region_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.service_token_roles_required = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.service_type = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.token_cache_time = 300 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.59/identity {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.backend = dogpile.cache.null {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.backend_argument = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.backend_expiration_time = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.config_prefix = cache.oslo {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.debug_cache_backend = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.enable_retry_client = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.enable_socket_keepalive = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.expiration_time = 600 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.hashclient_retry_attempts = 2 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_dead_retry = 300 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_pool_maxsize = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_sasl_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.password = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.proxies = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.redis_db = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.redis_sentinel_service_name = mymaster {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.redis_server = localhost:6379 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.retry_attempts = 2 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.retry_delay = 0.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.socket_keepalive_count = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.socket_keepalive_idle = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.socket_keepalive_interval = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.socket_timeout = 1.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.tls_allowed_ciphers = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.tls_cafile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.tls_certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.tls_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.tls_keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cache.username = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] coordination.backend_url = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.asyncio_connection = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.asyncio_slave_connection = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.backend = sqlalchemy {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.connection = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.connection_debug = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.connection_parameters = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.connection_recycle_time = 3600 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.connection_trace = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.db_inc_retry_interval = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.db_max_retries = 20 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.db_max_retry_interval = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.db_retry_interval = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.max_overflow = 50 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.max_pool_size = 5 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.max_retries = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.mysql_wsrep_sync_wait = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.pool_timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.retry_interval = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.slave_connection = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.sqlite_synchronous = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.synchronous_reader = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] database.use_db_reconnect = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.connection_string = messaging:// {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.es_doc_type = notification {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.es_scroll_size = 10000 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.es_scroll_time = 2m {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.filter_error_trace = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.hmac_keys = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.sentinel_service_name = mymaster {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.socket_timeout = 0.1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.trace_requests = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler.trace_sqlalchemy = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler_jaeger.process_tags = {} {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler_jaeger.service_name_prefix = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] profiler_otlp.service_name_prefix = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.enforce_new_defaults = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.enforce_scope = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.policy_default_rule = default {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.policy_file = policy.yaml {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_policy.remote_timeout = 60.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.group = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.helper_command = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] privsep_osbrick.user = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.group = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.helper_command = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] cinder_sys_admin.user = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.auth_section = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.auth_type = password {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.cafile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.collect_timing = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.insecure = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.send_service_user_token = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.split_loggers = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] service_user.timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack sudo[76368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.auth_section = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.auth_type = password {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.collect_timing = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.insecure = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.region_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.split_loggers = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] glance.timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.backend_availability_zone = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.chap_password = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.chap_username = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.disk_geometry = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.driver_client_cert = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.driver_client_cert_key = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.driver_data_namespace = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.driver_use_ssl = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.enable_unsupported_driver = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.extra_capabilities = {} {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.filter_function = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.goodness_function = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.iscsi_target_flags = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.iscsi_write_cache = on {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.iser_helper = tgtadm {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.iser_ip_address = 192.168.122.59 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.iser_port = 3260 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.lvm_mirrors = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.lvm_share_target = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.lvm_type = auto {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.num_shell_tries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.nvmet_port_id = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.replication_device = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.report_discard_supported = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.reserved_percentage = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.scst_target_driver = iscsi {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.scst_target_iqn_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.storage_protocol = iSCSI {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.target_helper = tgtadm {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.target_ip_address = 192.168.122.59 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.target_port = 3260 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.target_protocol = iscsi {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.trace_flags = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.unique_fqdn_network = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.use_chap_auth = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_backend_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_clear = zero {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_clear_ionice = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_clear_size = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volume_group = cinder-volumes {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_reports.file_event_handler = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_reports.log_dir = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.backend_availability_zone = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.backend_host = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.chap_password = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.chap_username = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.chiscsi_conf = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.disk_geometry = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.driver_client_cert = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.driver_data_namespace = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.driver_use_ssl = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.extra_capabilities = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.filter_function = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.goodness_function = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.iser_helper = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.iser_ip_address = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.iser_port = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.iser_target_prefix = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.lvm_conf_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.lvm_mirrors = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.lvm_share_target = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.lvm_type = auto {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.num_shell_tries = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.nvmet_port_id = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.replication_device = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.report_discard_supported = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.reserved_percentage = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.scst_target_driver = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.storage_protocol = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.target_helper = lioadm {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.target_ip_address = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.target_port = 3260 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.target_protocol = iscsi {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.trace_flags = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.use_chap_auth = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_clear = zero {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_clear_size = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] lvmdriver-1.volumes_dir = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.ssl_version = {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_notifications.driver = [] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_notifications.retry = -1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] oslo_messaging_notifications.transport_url = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] key_manager.fixed_key = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.barbican_api_version = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.barbican_endpoint = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.barbican_endpoint_type = public {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.barbican_region_name = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.cafile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.collect_timing = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.insecure = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.number_of_retries = 60 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.retry_delay = 1 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.send_service_user_token = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.split_loggers = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.verify_ssl = True {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican.verify_ssl_path = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.auth_section = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.auth_type = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.cafile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.certfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.collect_timing = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.insecure = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.keyfile = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.split_loggers = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] barbican_service_user.timeout = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.approle_role_id = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.approle_secret_id = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.kv_mountpoint = secret {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.kv_path = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.kv_version = 2 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.namespace = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.root_token_id = **** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.ssl_ca_crt_file = None {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.timeout = 60.0 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.use_ssl = False {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:39:51 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] ******************************************************************************** {{(pid=76204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 05:39:52 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:52 devstack sudo[76373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:39:52 devstack sudo[76373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:52 devstack sudo[76373]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.649s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:39:52 devstack cinder-volume[76364]: INFO cinder.brick.local_dev.lvm [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:52 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:52 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:39:52 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:53 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:53 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:53 devstack cinder-volume[76364]: DEBUG cinder.brick.local_dev.lvm [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76364) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 05:39:53 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:53 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:39:53 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:55 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:55 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.745s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:55 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:55 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:55 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:55 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:39:55 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:55 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:55 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:55 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:56 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:56 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:56 devstack sudo[77148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 05:39:56 devstack sudo[77148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:56 devstack sudo[77148]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:56 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.650s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:56 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:56 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:39:56 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:57 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:57 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.822s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:57 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:57 devstack sudo[77164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:39:57 devstack sudo[77164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:58 devstack sudo[77164]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:58 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.951s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:58 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:58 devstack sudo[77169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:39:58 devstack sudo[77169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:59 devstack sudo[77169]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:59 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:59 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:59 devstack sudo[77179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:39:59 devstack sudo[77179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:39:59 devstack sudo[77179]: pam_unix(sudo:session): session closed for user root Jul 10 05:39:59 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:59 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:59 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:39:59 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:39:59 devstack sudo[77183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:39:59 devstack sudo[77183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:00 devstack sudo[77183]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:00 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:00 devstack cinder-volume[76364]: INFO cinder.volume.drivers.lvm [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 05:40:00 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:00 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.063s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:00 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:00 devstack sudo[77196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:40:00 devstack sudo[77196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:01 devstack cinder-volume[76204]: DEBUG dbcounter [-] [76204] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:40:01 devstack sudo[77196]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:01 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.737s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:01 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:40:01 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:01 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:40:01 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:02 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:02 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:02 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:02 devstack sudo[77450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:40:02 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:02 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:02 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:02 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:02 devstack sudo[77453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:40:02 devstack sudo[77453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:03 devstack sudo[77453]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:03 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:03 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:03 devstack sudo[77457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:40:03 devstack sudo[77457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:03 devstack sudo[77457]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:03 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:03 devstack cinder-volume[76364]: INFO cinder.volume.driver [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 05:40:03 devstack cinder-volume[76364]: DEBUG cinder.volume.driver [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76364) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG oslo_db.sqlalchemy.engines [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76364) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writer thread running {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG cinder.db.api [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Building query based on filter {{(pid=76364) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG cinder.image.image_utils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76364) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1300}} Jul 10 05:40:04 devstack cinder-volume[76364]: INFO cinder.keymgr.migration [None req-2985cbcb-3b62-4c97-9cba-3980ddd87772 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:04 devstack sudo[77465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:40:04 devstack sudo[77465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:04 devstack sudo[77465]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:04 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:04 devstack sudo[77468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:40:04 devstack sudo[77468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:05 devstack sudo[77468]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:05 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:05 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:05 devstack sudo[77471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:40:05 devstack sudo[77471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:05 devstack sudo[77471]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:05 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:05 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:05 devstack sudo[77474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:40:05 devstack sudo[77474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:06 devstack sudo[77474]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:06 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:06 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:40:06 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Driver initialization completed successfully. Jul 10 05:40:06 devstack cinder-volume[76364]: INFO cinder.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Initiating service 2 cleanup Jul 10 05:40:06 devstack cinder-volume[76364]: INFO cinder.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Service 2 cleanup completed. Jul 10 05:40:06 devstack cinder-volume[76364]: DEBUG cinder.service [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Creating RPC server for service cinder-volume {{(pid=76364) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 05:40:06 devstack cinder-volume[76364]: DEBUG cinder.service [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76364) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 05:40:06 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 05:40:06 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:40:06 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:06 devstack sudo[77479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:40:06 devstack sudo[77479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:07 devstack sudo[77479]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:07 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:07 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:07 devstack sudo[77486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:40:07 devstack sudo[77486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:08 devstack sudo[77486]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:08 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:08 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:08 devstack sudo[77495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:40:08 devstack sudo[77495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:08 devstack sudo[77495]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:08 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:08 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:40:08 devstack sudo[77552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:40:08 devstack sudo[77552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:40:09 devstack sudo[77552]: pam_unix(sudo:session): session closed for user root Jul 10 05:40:09 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:40:09 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-789af026-71f0-499d-98d8-9ea93985cf37 None None] Driver post RPC initialization completed successfully. Jul 10 05:40:18 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:40:18 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:40:18 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread info: [<_MainThread(MainThread, started 131060607660160)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:40:19 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=3 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:40:19 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:41:18 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:41:18 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:41:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:41:18 devstack sudo[79598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:41:18 devstack sudo[79598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:41:19 devstack sudo[79598]: pam_unix(sudo:session): session closed for user root Jul 10 05:41:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:41:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:41:19 devstack sudo[79608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:41:19 devstack sudo[79608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:41:19 devstack sudo[79608]: pam_unix(sudo:session): session closed for user root Jul 10 05:41:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:41:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:41:19 devstack sudo[79613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:41:19 devstack sudo[79613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:41:20 devstack sudo[79613]: pam_unix(sudo:session): session closed for user root Jul 10 05:41:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:41:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:41:20 devstack sudo[79739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:41:20 devstack sudo[79739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:41:21 devstack sudo[79739]: pam_unix(sudo:session): session closed for user root Jul 10 05:41:21 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:41:21 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:41:21 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:41:21 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:41:21 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread info: [<_MainThread(MainThread, started 131060607660160)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:42:18 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:42:18 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:42:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:42:18 devstack sudo[82812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:42:18 devstack sudo[82812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:42:19 devstack sudo[82812]: pam_unix(sudo:session): session closed for user root Jul 10 05:42:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:42:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:42:19 devstack sudo[82816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:42:19 devstack sudo[82816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:42:19 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:42:19 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:UPDATE=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:42:19 devstack sudo[82816]: pam_unix(sudo:session): session closed for user root Jul 10 05:42:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:42:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:42:19 devstack sudo[82821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:42:19 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:42:20 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:42:20 devstack sudo[82829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:42:20 devstack sudo[82829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:42:20 devstack sudo[82829]: pam_unix(sudo:session): session closed for user root Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:42:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread info: [<_MainThread(MainThread, started 131060607660160)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:43:18 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:43:18 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:43:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:43:18 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:43:18 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:43:19 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Jul 10 05:43:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:43:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:43:19 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:43:19 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:43:19 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Jul 10 05:43:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:43:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:43:19 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:43:19 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:43:20 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Jul 10 05:43:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:43:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:43:20 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:43:20 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:43:21 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Jul 10 05:43:21 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:43:21 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:44:18 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:44:18 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 05:44:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:18 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 05:44:18 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:19 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:19 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:44:19 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:19 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:44:19 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:UPDATE=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:44:19 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:19 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 05:44:19 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:20 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:20 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 05:44:20 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:21 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:21 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:21 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:44:21 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:44:21 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:44:21 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-f72982b8-8d2d-40e8-8999-1db91618e90f None None] thread info: [<_MainThread(MainThread, started 131060607660160)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:44:27 devstack cinder-volume[76204]: INFO oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Caught SIGTERM, stopping children Jul 10 05:44:27 devstack cinder-volume[76204]: DEBUG oslo_concurrency.lockutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Acquiring lock "singleton_lock" {{(pid=76204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:44:27 devstack cinder-volume[76204]: DEBUG oslo_concurrency.lockutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Acquired lock "singleton_lock" {{(pid=76204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:44:27 devstack cinder-volume[76204]: DEBUG oslo_concurrency.lockutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Releasing lock "singleton_lock" {{(pid=76204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:44:27 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Stop services. {{(pid=76204) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 05:44:27 devstack cinder-volume[76204]: DEBUG oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Killing children. {{(pid=76204) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 05:44:27 devstack cinder-volume[76204]: INFO oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Waiting on 1 children to exit Jul 10 05:44:31 devstack cinder-volume[76364]: DEBUG oslo_concurrency.lockutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Acquiring lock "singleton_lock" {{(pid=76364) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:44:31 devstack cinder-volume[76364]: DEBUG oslo_concurrency.lockutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Acquired lock "singleton_lock" {{(pid=76364) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:44:31 devstack cinder-volume[76364]: DEBUG oslo_concurrency.lockutils [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Releasing lock "singleton_lock" {{(pid=76364) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:44:31 devstack cinder-volume[76364]: WARNING amqp [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 05:44:31 devstack cinder-volume[76364]: WARNING amqp [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 05:44:31 devstack cinder-volume[76204]: INFO oslo_service.backend._eventlet.service [None req-78147082-2005-403c-a26f-275e10e1e9fc None None] Child 76364 exited with status 0 Jul 10 05:44:32 devstack cinder-volume[86462]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 05:44:32 devstack cinder-volume[86462]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 05:44:32 devstack cinder-volume[86462]: we strongly recommend against using it for new projects. Jul 10 05:44:32 devstack cinder-volume[86462]: If you are already using Eventlet, we recommend migrating to a different Jul 10 05:44:32 devstack cinder-volume[86462]: framework. For more detail see Jul 10 05:44:32 devstack cinder-volume[86462]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 05:44:32 devstack cinder-volume[86462]: import eventlet # noqa Jul 10 05:44:34 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:44:34 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:44:34 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:44:34 devstack cinder-volume[86462]: INFO dbcounter [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Registered counter for database cinder Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG dbcounter [-] [86462] Writer thread running {{(pid=86462) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 05:44:35 devstack cinder-volume[86462]: INFO cinder.rpc [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 05:44:35 devstack cinder-volume[86462]: INFO cinder.rpc [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:35 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Determined volume DB was empty at startup. Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG cinder.volume.manager [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86462) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 05:44:35 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 05:44:35 devstack cinder-volume[86462]: WARNING stevedore.named [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 05:44:35 devstack cinder-volume[86462]: WARNING castellan.key_manager [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:44:35 devstack cinder-volume[86462]: WARNING cinder.keymgr.conf_key_mgr [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:44:35 devstack cinder-volume[86462]: INFO cinder.volume.manager [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_db.sqlalchemy.engines [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86462) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:35 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Starting 1 workers Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Started child 86679 {{(pid=86462) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Full set of CONF: {{(pid=86462) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] ******************************************************************************** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Configuration options gathered from: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] ================================================================================ {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] allow_availability_zone_fallback = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] allow_compression_on_image_upload = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] allowed_direct_url_schemes = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] api_rate_limit = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] auth_strategy = keystone {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_host = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_stats_polling_interval = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backup_api_class = cinder.backup.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backup_name_template = backup-%s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backup_use_same_host = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backup_use_temp_snapshot = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] chap_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] chap_username = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_internal_tenant_project_id = 864921a4c8794f4c8547c1739fc25be8 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_internal_tenant_user_id = 13c34bf95c7e44189bcea0354764ca34 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cluster = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] compression_format = gzip {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] compute_api_class = cinder.compute.nova.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] config_dir = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] config_source = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86679]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] control_exchange = openstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] debug = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] default_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] default_group_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] default_volume_type = QuobyteHD {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] disk_geometry = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] driver_client_cert = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] driver_client_cert_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] driver_data_namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] driver_ssl_cert_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] driver_ssl_cert_verify = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] driver_use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] enable_new_services = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] enable_unsupported_driver = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] enabled_backends = ['QuobyteHD'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] enforce_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] filter_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_api_insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_api_servers = ['http://192.168.122.59/image'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_api_ssl_compression = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_ca_certificates_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_catalog_info = image:glance:publicURL {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_num_retries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance_request_timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] goodness_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] graceful_shutdown_timeout = 5 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] group_api_class = cinder.group.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] host = devstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_compress_on_upload = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_conversion_address_space_limit = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_conversion_cpu_limit = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_conversion_disable = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_upload_use_cinder_backend = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_upload_use_internal_tenant = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_volume_cache_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_volume_cache_max_count = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] image_volume_cache_max_size_gb = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] init_host_max_objects_retrieval = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] instance_format = [instance: %(uuid)s] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] iscsi_target_flags = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] iscsi_write_cache = on {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] iser_helper = tgtadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] iser_ip_address = 192.168.122.59 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] iser_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_color = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_config_append = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_dir = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_options = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_rotate_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_rotate_interval_type = days {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] log_rotation_type = none {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] max_age = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] max_logfile_count = 30 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] max_logfile_size_mb = 200 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] max_over_subscription_ratio = 20.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] message_reap_interval = 86400 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] message_ttl = 2592000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] migration_create_volume_timeout_secs = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] monkey_patch = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] monkey_patch_modules = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] my_ip = 192.168.122.59 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] no_snapshot_gb_quota = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] num_iser_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] num_shell_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] num_volume_device_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] nvmeof_conn_info_version = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] nvmet_ns_id = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] nvmet_port_id = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_max_limit = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_volume_ext_list = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_volume_listen_port = 8776 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_volume_use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] osapi_volume_workers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] per_volume_size_limit = -1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] periodic_fuzzy_delay = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] periodic_interval = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] public_endpoint = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] publish_errors = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_backup_gigabytes = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_backups = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_gigabytes = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_groups = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_snapshots = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] quota_volumes = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] rate_limit_burst = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] rate_limit_except_level = CRITICAL {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] rate_limit_interval = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] reinit_driver_count = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] replication_device = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] report_discard_supported = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] report_interval = 120 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] reservation_clean_interval = 86400 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] reservation_expire = 86400 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] reserved_image_namespaces = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] reserved_percentage = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] rpc_response_timeout = 120 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] run_external_periodic_tasks = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] scst_target_driver = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] scst_target_iqn_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_down_time = 720 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] shell_completion = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] snapshot_name_template = snapshot-%s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] state_path = /opt/stack/data/cinder {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] storage_availability_zone = nova {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] storage_protocol = iSCSI {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] syslog_log_facility = LOG_USER {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] target_helper = lioadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] target_ip_address = 192.168.122.59 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] target_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] target_protocol = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] target_secondary_ip_addresses = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] trace_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] transport_url = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] until_refresh = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_chap_auth = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_default_quota_class = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_journal = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_json = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_stderr = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] use_syslog = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] verify_glance_signatures = enabled {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_api_class = cinder.volume.api.API {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.remotefs [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86679) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_backend_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_clear = zero {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_clear_ionice = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_clear_size = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_copy_bps_limit = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_dd_blocksize = 1M {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_name_template = volume-%s {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_service_inithost_offload = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volume_usage_audit_period = month {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] zoning_mode = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_concurrency.disable_process_locking = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.auth_type = password {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.auth_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.cache = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.include_service_catalog = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.interface = public {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_password = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcache_username = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.region_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.service_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.59/identity {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.backend = dogpile.cache.null {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.backend_argument = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.backend_expiration_time = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.config_prefix = cache.oslo {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.debug_cache_backend = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.enable_retry_client = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.enable_socket_keepalive = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.expiration_time = 600 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.hashclient_retry_attempts = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_dead_retry = 300 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_pool_maxsize = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_sasl_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.proxies = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.redis_db = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.redis_server = localhost:6379 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.retry_attempts = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.retry_delay = 0.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.socket_keepalive_count = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.socket_keepalive_idle = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.socket_keepalive_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.socket_timeout = 1.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.tls_allowed_ciphers = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.tls_cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.tls_certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.tls_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.tls_keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cache.username = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] coordination.backend_url = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.asyncio_connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.asyncio_slave_connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.backend = sqlalchemy {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.connection_debug = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.connection_parameters = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.connection_recycle_time = 3600 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.connection_trace = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.db_inc_retry_interval = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.db_max_retries = 20 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.db_max_retry_interval = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.db_retry_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.max_overflow = 50 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.max_pool_size = 5 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.max_retries = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.mysql_wsrep_sync_wait = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.pool_timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.retry_interval = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.slave_connection = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.sqlite_synchronous = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.synchronous_reader = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] database.use_db_reconnect = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.connection_string = messaging:// {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.es_doc_type = notification {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.es_scroll_size = 10000 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.es_scroll_time = 2m {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.filter_error_trace = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.hmac_keys = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.sentinel_service_name = mymaster {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.socket_timeout = 0.1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.trace_requests = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler.trace_sqlalchemy = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler_jaeger.process_tags = {} {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler_jaeger.service_name_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] profiler_otlp.service_name_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.enforce_new_defaults = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.enforce_scope = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.policy_default_rule = default {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.policy_file = policy.yaml {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.group = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.helper_command = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] privsep_osbrick.user = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.group = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.helper_command = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] cinder_sys_admin.user = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.auth_type = password {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.send_service_user_token = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] service_user.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.auth_type = password {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.region_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] glance.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.backend_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.chap_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.chap_username = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.disk_geometry = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.driver_client_cert = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.driver_client_cert_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.driver_data_namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.driver_use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.extra_capabilities = {} {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.filter_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.goodness_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.iscsi_target_flags = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.iscsi_write_cache = on {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.iser_helper = tgtadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.iser_ip_address = 192.168.122.59 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.iser_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_host = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_login = admin {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_mount_options = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_private_key = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_share_path = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86679) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 05:44:35 devstack cinder-volume[86679]: WARNING cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 05:44:35 devstack cinder-volume[86679]: WARNING cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.num_shell_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Running cmd (subprocess): mount.quobyte {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.quobyte_volume_url = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.replication_device = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.report_discard_supported = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.reserved_percentage = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.target_helper = tgtadm {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.target_ip_address = 192.168.122.59 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.target_port = 3260 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.target_protocol = iscsi {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.trace_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.unique_fqdn_network = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.use_chap_auth = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_backend_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_clear = zero {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_clear_ionice = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_clear_size = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_reports.file_event_handler = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_reports.log_dir = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.backend_availability_zone = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.backend_host = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.chap_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.chap_username = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.chiscsi_conf = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.disk_geometry = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.driver_client_cert = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.driver_data_namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.driver_use_ssl = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.extra_capabilities = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.filter_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.goodness_function = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.iser_helper = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.iser_ip_address = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.iser_port = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.iser_target_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_host = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_login = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_mount_options = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_password = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_private_key = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_share_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_ssh_port = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.num_shell_tries = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.nvmet_port_id = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.replication_device = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.report_discard_supported = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.reserved_percentage = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.scst_target_driver = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.storage_protocol = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.target_helper = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.target_ip_address = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.target_port = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.target_prefix = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.target_protocol = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.trace_flags = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.use_chap_auth = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_clear = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_clear_size = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] QuobyteHD.volumes_dir = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack quobyte-client[86684]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack quobyte-client[86684]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_notifications.driver = [] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_notifications.retry = -1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] key_manager.fixed_key = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.barbican_api_version = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.barbican_endpoint = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.barbican_endpoint_type = public {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.barbican_region_name = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.number_of_retries = 60 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.retry_delay = 1 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.send_service_user_token = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.verify_ssl = True {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican.verify_ssl_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.auth_section = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.auth_type = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.cafile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.certfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.collect_timing = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.insecure = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.keyfile = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.split_loggers = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] barbican_service_user.timeout = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.approle_role_id = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.approle_secret_id = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.kv_mountpoint = secret {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.kv_path = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.kv_version = 2 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.namespace = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.root_token_id = **** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.ssl_ca_crt_file = None {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.timeout = 60.0 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.use_ssl = False {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:35 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] ******************************************************************************** {{(pid=86462) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:35 devstack cinder-volume[86679]: INFO cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d ... Jul 10 05:44:35 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 -c /etc/quobyte/client-cinder.cfg {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:35 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 -c /etc/quobyte/client-cinder.cfg Jul 10 05:44:35 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:36 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:36 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.833s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:36 devstack cinder-volume[86679]: INFO cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d succeeded Jul 10 05:44:36 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:36 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.862s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:36 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:36 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:36 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:37 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.646s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:37 devstack cinder-volume[86679]: INFO cinder.volume.driver [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG cinder.volume.driver [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86679) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG oslo_db.sqlalchemy.engines [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86679) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG dbcounter [-] [86679] Writer thread running {{(pid=86679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG cinder.db.api [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Building query based on filter {{(pid=86679) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG cinder.image.image_utils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86679) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1300}} Jul 10 05:44:37 devstack cinder-volume[86679]: INFO cinder.keymgr.migration [None req-4599c7c7-9166-46d1-b554-82ad7cfa3b69 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:37 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:37 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:37 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:38 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.687s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG cinder.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Notifying Schedulers of capabilities ... {{(pid=86679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:44:38 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Driver initialization completed successfully. Jul 10 05:44:38 devstack cinder-volume[86679]: INFO cinder.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Initiating service 3 cleanup Jul 10 05:44:38 devstack cinder-volume[86679]: INFO cinder.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Service 3 cleanup completed. Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG cinder.service [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Creating RPC server for service cinder-volume {{(pid=86679) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG cinder.service [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86679) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 05:44:38 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:38 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:38 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:38 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:39 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:39 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.748s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:39 devstack cinder-volume[86679]: INFO cinder.volume.manager [None req-64855617-cb65-44b3-a572-4b61d57fe760 None None] Driver post RPC initialization completed successfully. Jul 10 05:44:43 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:43 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:43 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=86679) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:43 devstack cinder-volume[86679]: DEBUG cinder.volume.drivers.quobyte [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=86679) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:43 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86679) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:43 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:43 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:43 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:44 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:44 devstack cinder-volume[86679]: DEBUG oslo_concurrency.processutils [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.624s {{(pid=86679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:44 devstack cinder-volume[86679]: DEBUG cinder.manager [None req-a46c5072-4de3-4851-ad31-18b40478e3e8 None None] Notifying Schedulers of capabilities ... {{(pid=86679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:44:45 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Caught SIGTERM, stopping children Jul 10 05:44:45 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Acquiring lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:44:45 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Acquired lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:44:45 devstack cinder-volume[86462]: DEBUG oslo_concurrency.lockutils [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Releasing lock "singleton_lock" {{(pid=86462) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:44:45 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Stop services. {{(pid=86462) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 05:44:45 devstack cinder-volume[86462]: DEBUG oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Killing children. {{(pid=86462) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 05:44:45 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Waiting on 1 children to exit Jul 10 05:44:45 devstack cinder-volume[86679]: DEBUG oslo_service.periodic_task [None req-0608538e-f86e-4b6b-9b7a-fea077016304 None None] Running periodic task VolumeManager._thread_info {{(pid=86679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:44:45 devstack cinder-volume[86679]: DEBUG cinder.volume.manager [None req-0608538e-f86e-4b6b-9b7a-fea077016304 None None] thread count: 6 {{(pid=86679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:44:45 devstack cinder-volume[86679]: DEBUG cinder.volume.manager [None req-0608538e-f86e-4b6b-9b7a-fea077016304 None None] thread info: [<_MainThread(MainThread, started 125393154904192)>, , , , , ] {{(pid=86679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:44:46 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Acquiring lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:44:46 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Acquired lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:44:46 devstack cinder-volume[86679]: DEBUG oslo_concurrency.lockutils [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Releasing lock "singleton_lock" {{(pid=86679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:44:46 devstack cinder-volume[86679]: WARNING amqp [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 05:44:46 devstack cinder-volume[86679]: WARNING amqp [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 05:44:46 devstack cinder-volume[86462]: INFO oslo_service.backend._eventlet.service [None req-075039b1-9bff-43d1-9447-68809e74f660 None None] Child 86679 exited with status 0 Jul 10 05:44:47 devstack cinder-volume[87162]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 05:44:47 devstack cinder-volume[87162]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 05:44:47 devstack cinder-volume[87162]: we strongly recommend against using it for new projects. Jul 10 05:44:47 devstack cinder-volume[87162]: If you are already using Eventlet, we recommend migrating to a different Jul 10 05:44:47 devstack cinder-volume[87162]: framework. For more detail see Jul 10 05:44:47 devstack cinder-volume[87162]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 05:44:47 devstack cinder-volume[87162]: import eventlet # noqa Jul 10 05:44:50 devstack cinder-volume[87162]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 05:44:50 devstack cinder-volume[87162]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 05:44:50 devstack cinder-volume[87162]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87162) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 05:44:51 devstack cinder-volume[87162]: INFO dbcounter [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Registered counter for database cinder Jul 10 05:44:51 devstack cinder-volume[87162]: DEBUG oslo_db.sqlalchemy.engines [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:51 devstack cinder-volume[87162]: DEBUG dbcounter [-] [87162] Writer thread running {{(pid=87162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 05:44:51 devstack cinder-volume[87162]: INFO cinder.rpc [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 05:44:51 devstack cinder-volume[87162]: INFO cinder.rpc [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 05:44:51 devstack cinder-volume[87162]: DEBUG oslo_db.sqlalchemy.engines [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:51 devstack cinder-volume[87162]: INFO cinder.volume.manager [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Determined volume DB was empty at startup. Jul 10 05:44:51 devstack cinder-volume[87162]: DEBUG cinder.volume.manager [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87162) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 05:44:51 devstack cinder-volume[87162]: WARNING stevedore.named [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 05:44:51 devstack cinder-volume[87162]: WARNING castellan.key_manager [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:44:51 devstack cinder-volume[87162]: WARNING cinder.keymgr.conf_key_mgr [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 05:44:51 devstack cinder-volume[87162]: INFO cinder.volume.manager [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_db.sqlalchemy.engines [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:52 devstack cinder-volume[87162]: INFO oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Starting 1 workers Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Started child 87449 {{(pid=87162) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Full set of CONF: {{(pid=87162) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] ******************************************************************************** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] Configuration options gathered from: {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] ================================================================================ {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] allow_availability_zone_fallback = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] allow_compression_on_image_upload = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] allowed_direct_url_schemes = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] api_rate_limit = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] auth_strategy = keystone {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_availability_zone = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_host = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_stats_polling_interval = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backup_api_class = cinder.backup.api.API {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87449]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backup_name_template = backup-%s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backup_use_same_host = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backup_use_temp_snapshot = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] chap_password = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] chap_username = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_internal_tenant_project_id = 864921a4c8794f4c8547c1739fc25be8 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_internal_tenant_user_id = 13c34bf95c7e44189bcea0354764ca34 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cluster = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] compression_format = gzip {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] compute_api_class = cinder.compute.nova.API {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] config_dir = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] config_source = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] control_exchange = openstack {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] debug = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] default_availability_zone = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] default_group_type = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] default_volume_type = QuobyteHD {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] disk_geometry = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] driver_client_cert = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] driver_client_cert_key = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] driver_data_namespace = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] driver_ssl_cert_path = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] driver_ssl_cert_verify = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] driver_use_ssl = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] enable_new_services = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] enable_unsupported_driver = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] enabled_backends = ['QuobyteHD'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] enforce_multipath_for_image_xfer = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] filter_function = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_api_insecure = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_api_servers = ['http://192.168.122.59/image'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_api_ssl_compression = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_ca_certificates_file = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_catalog_info = image:glance:publicURL {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_num_retries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance_request_timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] goodness_function = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] graceful_shutdown_timeout = 5 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] group_api_class = cinder.group.api.API {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] host = devstack {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_compress_on_upload = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_conversion_address_space_limit = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_conversion_cpu_limit = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_conversion_disable = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_upload_use_cinder_backend = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_upload_use_internal_tenant = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_volume_cache_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_volume_cache_max_count = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] image_volume_cache_max_size_gb = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] init_host_max_objects_retrieval = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] instance_format = [instance: %(uuid)s] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] iscsi_target_flags = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] iscsi_write_cache = on {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] iser_helper = tgtadm {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] iser_ip_address = 192.168.122.59 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] iser_port = 3260 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_color = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87449) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_config_append = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_dir = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_file = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_options = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_rotate_interval = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_rotate_interval_type = days {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] log_rotation_type = none {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] max_age = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] max_logfile_count = 30 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] max_logfile_size_mb = 200 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] max_over_subscription_ratio = 20.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] message_reap_interval = 86400 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] message_ttl = 2592000 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] migration_create_volume_timeout_secs = 300 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] monkey_patch = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] monkey_patch_modules = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] my_ip = 192.168.122.59 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] no_snapshot_gb_quota = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] num_iser_scan_tries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] num_shell_tries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] num_volume_device_scan_tries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] nvmeof_conn_info_version = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] nvmet_ns_id = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] nvmet_port_id = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_max_limit = 1000 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_volume_ext_list = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_volume_listen = 0.0.0.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_volume_listen_port = 8776 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_volume_use_ssl = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] osapi_volume_workers = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] per_volume_size_limit = -1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] periodic_fuzzy_delay = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] periodic_interval = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] project_id_regex = [0-9a-f\-]+ {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] public_endpoint = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] publish_errors = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_backup_gigabytes = 1000 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_backups = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_gigabytes = 1000 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_groups = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_snapshots = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] quota_volumes = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] rate_limit_burst = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] rate_limit_except_level = CRITICAL {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] rate_limit_interval = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] reinit_driver_count = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] replication_device = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] report_discard_supported = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] report_interval = 120 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] reservation_clean_interval = 86400 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] reservation_expire = 86400 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] reserved_image_namespaces = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] reserved_percentage = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] rpc_response_timeout = 120 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] run_external_periodic_tasks = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] scst_target_driver = iscsi {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] scst_target_iqn_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_down_time = 720 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] shell_completion = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] snapshot_name_template = snapshot-%s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] split_loggers = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] state_path = /opt/stack/data/cinder {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] storage_availability_zone = nova {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] storage_protocol = iSCSI {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] syslog_log_facility = LOG_USER {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] target_helper = lioadm {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] target_ip_address = 192.168.122.59 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] target_port = 3260 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] target_protocol = iscsi {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] target_secondary_ip_addresses = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] trace_flags = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] transfer_api_class = cinder.transfer.api.API {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] transport_url = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] until_refresh = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_chap_auth = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_default_quota_class = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_journal = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_json = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_multipath_for_image_xfer = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_stderr = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] use_syslog = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] verify_glance_signatures = enabled {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_api_class = cinder.volume.api.API {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_backend_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_clear = zero {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_clear_ionice = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_clear_size = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_copy_bps_limit = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_dd_blocksize = 1M {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_name_template = volume-%s {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_service_inithost_offload = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volume_usage_audit_period = month {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] zoning_mode = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_concurrency.disable_process_locking = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.auth_section = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.auth_type = password {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.auth_version = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.cache = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.include_service_catalog = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.insecure = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.interface = public {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_password = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcache_username = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.region_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.service_type = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.59/identity {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.backend = dogpile.cache.null {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.backend_argument = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.backend_expiration_time = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.config_prefix = cache.oslo {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.debug_cache_backend = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.enable_retry_client = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.enable_socket_keepalive = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.expiration_time = 600 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.hashclient_retry_attempts = 2 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_dead_retry = 300 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_pool_maxsize = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_sasl_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.password = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.proxies = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.redis_db = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87449) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 05:44:52 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 05:44:52 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.redis_server = localhost:6379 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.retry_attempts = 2 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.retry_delay = 0.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Running cmd (subprocess): mount.quobyte {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.socket_keepalive_count = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.socket_keepalive_idle = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.socket_keepalive_interval = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.socket_timeout = 1.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.tls_allowed_ciphers = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.tls_cafile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.tls_certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.tls_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.tls_keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cache.username = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] coordination.backend_url = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.asyncio_connection = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.asyncio_slave_connection = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.backend = sqlalchemy {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.connection = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.connection_debug = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.connection_parameters = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.connection_recycle_time = 3600 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.connection_trace = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.db_inc_retry_interval = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.db_max_retries = 20 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.db_max_retry_interval = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.db_retry_interval = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.max_overflow = 50 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.max_pool_size = 5 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.max_retries = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.mysql_wsrep_sync_wait = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.pool_timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.retry_interval = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.slave_connection = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.sqlite_synchronous = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.synchronous_reader = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] database.use_db_reconnect = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.connection_string = messaging:// {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.es_doc_type = notification {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.es_scroll_size = 10000 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.es_scroll_time = 2m {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.filter_error_trace = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.hmac_keys = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.sentinel_service_name = mymaster {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.socket_timeout = 0.1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.trace_requests = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler.trace_sqlalchemy = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler_jaeger.process_tags = {} {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler_jaeger.service_name_prefix = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] profiler_otlp.service_name_prefix = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.enforce_new_defaults = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.enforce_scope = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.policy_default_rule = default {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.policy_file = policy.yaml {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_policy.remote_timeout = 60.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.group = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.helper_command = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] privsep_osbrick.user = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.group = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.helper_command = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] cinder_sys_admin.user = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.auth_section = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.auth_type = password {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.cafile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.collect_timing = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.insecure = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.send_service_user_token = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.split_loggers = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] service_user.timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.auth_section = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.auth_type = password {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.collect_timing = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.insecure = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.region_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.split_loggers = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] glance.timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.backend_availability_zone = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.chap_password = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.chap_username = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.disk_geometry = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.driver_client_cert = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.driver_client_cert_key = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.driver_data_namespace = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.driver_use_ssl = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.extra_capabilities = {} {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.filter_function = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.goodness_function = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.iscsi_target_flags = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.iscsi_write_cache = on {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.iser_helper = tgtadm {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.iser_ip_address = 192.168.122.59 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.iser_port = 3260 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_host = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_login = admin {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_mount_options = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_password = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_private_key = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_share_path = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_ssh_port = 22 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.num_shell_tries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.quobyte_volume_url = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.replication_device = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.report_discard_supported = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.reserved_percentage = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.target_helper = tgtadm {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.target_ip_address = 192.168.122.59 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.target_port = 3260 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.target_protocol = iscsi {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.trace_flags = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.unique_fqdn_network = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.use_chap_auth = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_backend_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_clear = zero {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_clear_ionice = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_clear_size = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_reports.file_event_handler = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_reports.log_dir = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.backend_availability_zone = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.backend_host = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.chap_password = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.chap_username = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.chiscsi_conf = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.disk_geometry = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.driver_client_cert = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.driver_data_namespace = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.driver_use_ssl = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.extra_capabilities = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.filter_function = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.goodness_function = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.iscsi_target_flags = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.iscsi_write_cache = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.iser_helper = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.iser_ip_address = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.iser_port = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.iser_target_prefix = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_host = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_login = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_mount_options = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_password = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_private_key = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_share_path = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_ssh_port = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.num_shell_tries = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nvmet_ns_id = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.nvmet_port_id = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.replication_device = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.report_discard_supported = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.reserved_percentage = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.scst_target_driver = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.storage_protocol = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.target_helper = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.target_ip_address = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.target_port = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.target_prefix = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.target_protocol = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.trace_flags = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.unique_fqdn_network = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.use_chap_auth = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_clear = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_clear_ionice = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_clear_size = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] QuobyteHD.volumes_dir = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.ssl_version = {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_notifications.driver = [] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_notifications.retry = -1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] key_manager.fixed_key = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.barbican_api_version = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.barbican_endpoint = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.barbican_endpoint_type = public {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.barbican_region_name = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.cafile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.collect_timing = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.insecure = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.number_of_retries = 60 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.retry_delay = 1 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.send_service_user_token = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.split_loggers = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.verify_ssl = True {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican.verify_ssl_path = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.auth_section = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.auth_type = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.cafile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.certfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.collect_timing = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.insecure = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.keyfile = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.split_loggers = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] barbican_service_user.timeout = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.approle_role_id = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.approle_secret_id = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.kv_mountpoint = secret {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.kv_path = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.kv_version = 2 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.namespace = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.root_token_id = **** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.ssl_ca_crt_file = None {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.timeout = 60.0 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.use_ssl = False {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 05:44:52 devstack cinder-volume[87162]: DEBUG oslo_service.backend._eventlet.service [None req-731238f3-fb13-4c2f-a4ef-6835cf45862b None None] ******************************************************************************** {{(pid=87162) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 05:44:52 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:52 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:53 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.703s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:53 devstack cinder-volume[87449]: INFO cinder.volume.driver [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Driver hasn't implemented _init_vendor_properties() Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG cinder.volume.driver [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87449) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG oslo_db.sqlalchemy.engines [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87449) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writer thread running {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG cinder.db.api [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Building query based on filter {{(pid=87449) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87449) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1300}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:53 devstack cinder-volume[87449]: INFO cinder.keymgr.migration [None req-874599d1-8fbe-44ba-a626-98ecc1e83a37 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 05:44:53 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:53 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:54 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.649s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:44:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Driver initialization completed successfully. Jul 10 05:44:54 devstack cinder-volume[87449]: INFO cinder.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Initiating service 3 cleanup Jul 10 05:44:54 devstack cinder-volume[87449]: INFO cinder.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Service 3 cleanup completed. Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG cinder.service [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Creating RPC server for service cinder-volume {{(pid=87449) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG cinder.service [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87449) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 05:44:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:44:54 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:44:54 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:44:54 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Jul 10 05:44:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.605s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:44:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-38ebc1a0-0d17-4b19-b1d8-687d4759983a None None] Driver post RPC initialization completed successfully. Jul 10 05:45:02 devstack cinder-volume[87162]: DEBUG dbcounter [-] [87162] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87162) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:45:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:45:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:45:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:45:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 6 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:45:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:45:51 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:45:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Flow 'volume_create_manager' (fa7f7842-b98c-443e-832a-c772f3197b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:45:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47805f7-8bbc-4180-becc-1bad8ae52faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47805f7-8bbc-4180-becc-1bad8ae52faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1476955472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77ed80f1dce4b958ec186503a341403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:45:52Z,use_quota=True,user_id='8ef942e95e2f41adab1aede17d66094c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd13bc7e-40ff-481e-ad2f-fb76382f4e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd13bc7e-40ff-481e-ad2f-fb76382f4e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5993accb-3fae-450b-963f-9707440c52c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5993accb-3fae-450b-963f-9707440c52c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64', 'volume_name': 'volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e79cd4d-b48d-40a9-aa3f-4f0f8086ce4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e79cd4d-b48d-40a9-aa3f-4f0f8086ce4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108e2299-3528-4947-95c1-60ed9ed47a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:45:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Volume a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64', 'volume_size': 1} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1476955472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77ed80f1dce4b958ec186503a341403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:45:52Z,use_quota=True,user_id='8ef942e95e2f41adab1aede17d66094c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Creating volume a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:45:52 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:45:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:45:52 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 1073741824 Jul 10 05:45:52 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:45:53 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 1073741824" returned: 0 in 0.996s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:45:53 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 Jul 10 05:45:53 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:45:53 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" returned: 0 in 0.724s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108e2299-3528-4947-95c1-60ed9ed47a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab07f2e5-93b0-4bd4-9f3c-9eb2b0c91a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:45:53 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Volume volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 (a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64): created successfully Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab07f2e5-93b0-4bd4-9f3c-9eb2b0c91a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:45:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Flow 'volume_create_manager' (fa7f7842-b98c-443e-832a-c772f3197b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:45:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3be3e74e-61cd-421f-9b53-02cfd408ed67 tempest-TaggedAttachmentsTest-66183136 None] Created volume successfully. Jul 10 05:46:03 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:46:03 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Flow 'volume_create_manager' (928be04f-857a-49a4-878a-472edc9c5fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb12dd47-e74b-43ea-89e6-bef0b5c09720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb12dd47-e74b-43ea-89e6-bef0b5c09720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1307840987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bf686c-ad17-4462-9156-bfe9fd1b8e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf02a3b520b41ed90e666eb23db3c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:46:09Z,use_quota=True,user_id='64f346b3ad9f45f2931886e946e02561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d52d5a9-5167-43dc-8915-47c975ba6423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d52d5a9-5167-43dc-8915-47c975ba6423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397a6004-f234-47e5-804e-394269a21ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397a6004-f234-47e5-804e-394269a21ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5bf686c-ad17-4462-9156-bfe9fd1b8e18', 'volume_name': 'volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba749c-8148-4c1d-b21f-1cc2f24c4d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba749c-8148-4c1d-b21f-1cc2f24c4d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba41a4b8-4b44-43e8-ba00-da54fd9a8cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:08 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Volume f5bf686c-ad17-4462-9156-bfe9fd1b8e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18', 'volume_size': 1} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1307840987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bf686c-ad17-4462-9156-bfe9fd1b8e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf02a3b520b41ed90e666eb23db3c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:46:09Z,use_quota=True,user_id='64f346b3ad9f45f2931886e946e02561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Creating volume f5bf686c-ad17-4462-9156-bfe9fd1b8e18 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:46:08 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:46:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:09 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 1073741824 Jul 10 05:46:09 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:11 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 1073741824" returned: 0 in 2.526s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:11 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 Jul 10 05:46:11 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:12 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" returned: 0 in 1.192s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] <== create_volume: return (3848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.854s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba41a4b8-4b44-43e8-ba00-da54fd9a8cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7640d09b-506d-4c9e-9926-3bc2b09578c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Volume volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 (f5bf686c-ad17-4462-9156-bfe9fd1b8e18): created successfully Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7640d09b-506d-4c9e-9926-3bc2b09578c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Flow 'volume_create_manager' (928be04f-857a-49a4-878a-472edc9c5fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:46:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9add322c-7940-4c44-bdb2-f4e29cc1eb64 tempest-DeleteServersTestJSON-2042215047 None] Created volume successfully. Jul 10 05:46:22 devstack cinder-volume[87449]: WARNING py.warnings [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 10 05:46:22 devstack cinder-volume[87449]: .first() Jul 10 05:46:22 devstack cinder-volume[87449]: Jul 10 05:46:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:22 devstack cinder-volume[87449]: INFO oslo.privsep.daemon [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgkn2mw3q/privsep.sock'] Jul 10 05:46:22 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgkn2mw3q/privsep.sock Jul 10 05:46:22 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:22 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 05:46:23 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 05:46:24 devstack cinder-volume[87449]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 05:46:24 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:24 devstack cinder-volume[87449]: INFO oslo.privsep.daemon [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Spawned new privsep daemon via rootwrap Jul 10 05:46:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Accepted privsep connection to /tmp/tmpgkn2mw3q/privsep.sock {{(pid=87449) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 05:46:24 devstack cinder-volume[87449]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 05:46:24 devstack cinder-volume[87449]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 05:46:24 devstack cinder-volume[87449]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 05:46:24 devstack cinder-volume[87449]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88449 Jul 10 05:46:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d4e44e-98b7-417b-9eb6-dddbf2d85b4d]: (2,) {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:24 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Flow 'volume_create_manager' (6079cdc3-8d62-437d-8a7c-632189ea08d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9996de-f999-4ea5-bde9-f51a75df5a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc84362-2074-4e6f-88a6-1b9a891b6e39]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9996de-f999-4ea5-bde9-f51a75df5a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1873431286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325466e4-c410-4f04-87c6-6b86883edcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05498809b27b42d5956d67a7a330bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:46:25Z,use_quota=True,user_id='2e233f8dc3ad4e9d85fc9d8dd7406274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5be318b-6999-40dc-adf7-fa8769452208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5be318b-6999-40dc-adf7-fa8769452208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7676adf-d21d-4ba4-a973-5795f6ae56c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7676adf-d21d-4ba4-a973-5795f6ae56c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325466e4-c410-4f04-87c6-6b86883edcdf', 'volume_name': 'volume-325466e4-c410-4f04-87c6-6b86883edcdf', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:25 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 Jul 10 05:46:25 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd51c6d6-1e71-47d9-9340-c89ebafe04ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd51c6d6-1e71-47d9-9340-c89ebafe04ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d27dd5-4d08-4bad-bba8-9b43c52ddbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:25 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Volume 325466e4-c410-4f04-87c6-6b86883edcdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325466e4-c410-4f04-87c6-6b86883edcdf', 'volume_size': 1} Jul 10 05:46:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:26 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" returned: 0 in 1.323s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1873431286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325466e4-c410-4f04-87c6-6b86883edcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05498809b27b42d5956d67a7a330bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:46:25Z,use_quota=True,user_id='2e233f8dc3ad4e9d85fc9d8dd7406274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Creating volume 325466e4-c410-4f04-87c6-6b86883edcdf {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:46:26 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:26 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf 1073741824 Jul 10 05:46:26 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e69e6f9-c0e5-4e6f-a726-7bafad70c408', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:46:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-99b420bf-255b-4a04-9049-e92d5779499e req-f3e70bef-f613-4a95-bb6d-8659a4306a65 tempest-DeleteServersTestJSON-2042215047 None] attachment_update completed successfully. Jul 10 05:46:28 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf 1073741824" returned: 0 in 1.579s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:28 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf Jul 10 05:46:28 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:28 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:46:28 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:29 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf" returned: 0 in 1.892s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] <== create_volume: return (3540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:46:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.556s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d27dd5-4d08-4bad-bba8-9b43c52ddbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325466e4-c410-4f04-87c6-6b86883edcdf', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf65919-5e6b-40ad-b325-c71ca53da7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:30 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Volume volume-325466e4-c410-4f04-87c6-6b86883edcdf (325466e4-c410-4f04-87c6-6b86883edcdf): created successfully Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf65919-5e6b-40ad-b325-c71ca53da7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Flow 'volume_create_manager' (6079cdc3-8d62-437d-8a7c-632189ea08d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:46:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9fe95d28-35f4-46c7-960b-83dd6bfdedb9 tempest-VolumesAdminNegativeTest-726540639 None] Created volume successfully. Jul 10 05:46:30 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.756s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:46:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:46:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Acquiring lock "cinder-325466e4-c410-4f04-87c6-6b86883edcdf-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Lock "cinder-325466e4-c410-4f04-87c6-6b86883edcdf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Acquiring lock "cinder-quobyte-325466e4-c410-4f04-87c6-6b86883edcdf" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Lock "cinder-quobyte-325466e4-c410-4f04-87c6-6b86883edcdf" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafe9224-c968-4f52-b787-1778935cd330]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:31 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf Jul 10 05:46:31 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:33 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf" returned: 0 in 1.902s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:33 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf Jul 10 05:46:33 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:34 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-325466e4-c410-4f04-87c6-6b86883edcdf" returned: 0 in 1.198s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Lock "cinder-quobyte-325466e4-c410-4f04-87c6-6b86883edcdf" released by "delete_volume" :: held 3.158s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:46:34 devstack cinder-volume[87449]: WARNING cinder.quota [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:46:34 devstack cinder-volume[87449]: WARNING cinder.quota [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:46:34 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Created reservations ['5615b9fd-582c-4667-83b2-1143bb312430', 'fe930a50-7b29-476e-91d1-bce12765ef9a', '8ea5a593-8a53-48d0-a4d2-b12e5c4642bb', '32cde47c-6bbe-4329-b9ce-8ac9706ec945'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:46:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:46:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:46:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:35 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:46:35 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:37 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 2.044s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:37 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:46:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Deleted volume successfully. Jul 10 05:46:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c45026b9-6809-4d90-b77b-7b5a4c48517c tempest-VolumesAdminNegativeTest-726540639 None] Lock "cinder-325466e4-c410-4f04-87c6-6b86883edcdf-delete_volume" released by "delete_volume" :: held 5.643s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:46:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-fe400a5b-5542-47fe-a5a3-5a21e2d590c5 req-54dc5008-2fba-4a49-9f02-80f285bfd4c9 tempest-DeleteServersTestJSON-2042215047 None] Terminate volume connection completed successfully. Jul 10 05:46:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-fe400a5b-5542-47fe-a5a3-5a21e2d590c5 req-54dc5008-2fba-4a49-9f02-80f285bfd4c9 tempest-DeleteServersTestJSON-2042215047 None] Deleting attachment 7e69e6f9-c0e5-4e6f-a726-7bafad70c408. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Flow 'volume_create_manager' (6ac0f6cb-f267-4269-bb6d-64c283344e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823ad4f9-078e-4a36-9023-672e6290e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823ad4f9-078e-4a36-9023-672e6290e949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1799875180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9e6c72-d477-42d8-aa51-53d06cfa045b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c88a048134ac1b746c40e8e986f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:46:42Z,use_quota=True,user_id='e2b39e2513ed4b24aaf8342ca9b67d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1042c1f7-c7aa-465b-9026-e815b71e9be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1042c1f7-c7aa-465b-9026-e815b71e9be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668c1e82-97c9-4be9-a6a8-bbf46bf948e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668c1e82-97c9-4be9-a6a8-bbf46bf948e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9e6c72-d477-42d8-aa51-53d06cfa045b', 'volume_name': 'volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10b9b72-ccd5-4d9d-8bc5-10bad794044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10b9b72-ccd5-4d9d-8bc5-10bad794044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72934f8e-9f9b-4f94-b946-28b9d6c997b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b', 'volume_size': 1} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1799875180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9e6c72-d477-42d8-aa51-53d06cfa045b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2c88a048134ac1b746c40e8e986f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:46:42Z,use_quota=True,user_id='e2b39e2513ed4b24aaf8342ca9b67d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Creating volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:46:41 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:46:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:42 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b 1073741824 Jul 10 05:46:42 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:42 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b 1073741824" returned: 0 in 0.819s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:42 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b Jul 10 05:46:42 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Acquiring lock "cinder-f5bf686c-ad17-4462-9156-bfe9fd1b8e18-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Lock "cinder-f5bf686c-ad17-4462-9156-bfe9fd1b8e18-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Acquiring lock "cinder-quobyte-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Lock "cinder-quobyte-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edee10f-2e8c-454d-96ca-50d204008fb3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:43 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 Jul 10 05:46:43 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:43 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72934f8e-9f9b-4f94-b946-28b9d6c997b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f7b682-198d-4bcb-bac8-75fed0d47f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:46:43 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Volume volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b (9e9e6c72-d477-42d8-aa51-53d06cfa045b): created successfully Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f7b682-198d-4bcb-bac8-75fed0d47f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Flow 'volume_create_manager' (6ac0f6cb-f267-4269-bb6d-64c283344e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:46:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7e1af5ad-d0f1-42cd-9156-583c41800b9d tempest-SnapshotsActionsTest-35218742 None] Created volume successfully. Jul 10 05:46:43 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:44 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18 Jul 10 05:46:44 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Creating offline snapshot 8d000cf4-f5e9-4ada-8c3a-dc6e6343884e of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[453fa3bd-2218-4302-aa62-0428e5437924]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:44 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b Jul 10 05:46:44 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:44 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" returned: 0 in 0.685s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Lock "cinder-quobyte-f5bf686c-ad17-4462-9156-bfe9fd1b8e18" released by "delete_volume" :: held 1.512s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Created reservations ['b9f5750b-fab6-456e-aca3-dc4908d9b2b3', 'ff1139c7-3711-4f3e-b203-3675c61bd8a1', '6ecbe937-72fb-4ca2-9def-ca1d36bb031a', 'de34c023-af9f-46c6-b118-b2b335b3f797'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:44 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:46:44 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:44 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b" returned: 0 in 0.778s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:45 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e 1G Jul 10 05:46:45 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:45 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.731s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:45 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:46:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Deleted volume successfully. Jul 10 05:46:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a844ebc-d5c1-49d1-a2f6-30207878931f tempest-DeleteServersTestJSON-2042215047 None] Lock "cinder-f5bf686c-ad17-4462-9156-bfe9fd1b8e18-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:46:45 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e 1G" returned: 0 in 0.931s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:45 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:46:45 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:46 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.765s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:46 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e is being set with open permissions: ugo+rw Jul 10 05:46:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:46 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:46:46 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:47 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.802s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:47 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info Jul 10 05:46:47 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:48 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info" returned: 0 in 0.979s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:48 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info is being set with open permissions: ugo+rw Jul 10 05:46:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:48 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info Jul 10 05:46:48 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:49 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.info" returned: 0 in 1.017s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.406s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1368abe1-fb35-4131-8701-e884335389c0 tempest-SnapshotsActionsTest-35218742 None] Create snapshot completed successfully Jul 10 05:46:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:46:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:46:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Creating offline snapshot 753de8ff-cba7-4c8f-8a03-88730df59fb8 of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:46:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8d7fb-a308-4ae8-8a7f-dda4edfae69b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:51 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:46:51 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:52 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.963s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:46:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:52 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 1G Jul 10 05:46:52 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:53 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 1G" returned: 0 in 0.941s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:53 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 Jul 10 05:46:53 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:54 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8" returned: 0 in 0.844s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:54 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 is being set with open permissions: ugo+rw Jul 10 05:46:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:54 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 Jul 10 05:46:54 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:55 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8" returned: 0 in 0.700s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.554s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:46:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d8d25792-31b2-43db-aab9-9aa8a54abf4b tempest-SnapshotsActionsTest-35218742 None] Create snapshot completed successfully Jul 10 05:46:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-753de8ff-cba7-4c8f-8a03-88730df59fb8-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-753de8ff-cba7-4c8f-8a03-88730df59fb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-753de8ff-cba7-4c8f-8a03-88730df59fb8" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-753de8ff-cba7-4c8f-8a03-88730df59fb8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Deleting offline snapshot 753de8ff-cba7-4c8f-8a03-88730df59fb8 of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] snapshot_file for this snap is: volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c799a485-151d-4dd3-a757-ad45c41632a5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:56 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 Jul 10 05:46:56 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:56 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8" returned: 0 in 0.870s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fccf628-c72f-4d49-8d3b-af7263fda2a9]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:46:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:57 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:46:57 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:57 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.957s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:46:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:57 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 Jul 10 05:46:57 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:58 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8" returned: 0 in 0.888s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:46:58 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8 Jul 10 05:46:58 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:46:59 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Jul 10 05:46:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.753de8ff-cba7-4c8f-8a03-88730df59fb8" returned: 0 in 0.773s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:46:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-753de8ff-cba7-4c8f-8a03-88730df59fb8" released by "_delete_snapshot" :: held 3.608s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:46:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" released by "delete_snapshot" :: held 3.641s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:46:59 devstack cinder-volume[87449]: WARNING cinder.quota [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:46:59 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Created reservations ['3ca226bd-b0c1-4fed-b444-4176f6e9da52', '101a0aa5-a09e-4fa9-9697-5bff5c0c0305', '862a16fa-8e56-4564-ba63-aaadf6215d4c', '03369bb8-1de7-42da-b14c-22ffc4900dff'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:46:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Delete snapshot completed successfully. Jul 10 05:46:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bb88e933-46ff-4f6e-bc8a-842e1cccfc91 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-753de8ff-cba7-4c8f-8a03-88730df59fb8-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Creating offline snapshot ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:47:00 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77614cf-d558-4b62-9fad-5499e63c66e9]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:01 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:01 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:01 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.864s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:01 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 1G Jul 10 05:47:01 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:02 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 1G" returned: 0 in 1.108s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:02 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 Jul 10 05:47:02 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:03 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" returned: 0 in 0.873s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:03 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 is being set with open permissions: ugo+rw Jul 10 05:47:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:03 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 Jul 10 05:47:03 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:04 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" returned: 0 in 0.901s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=30,cinder:INSERT=10,cinder:DELETE=5,cinder:SELECT=37 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:47:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.908s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c0f1e05a-0ba8-475e-8c65-27cf0dc11961 tempest-SnapshotsActionsTest-35218742 None] Create snapshot completed successfully Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-ac3955ea-fe75-4dc8-aec6-e11d87dd12b1-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-ac3955ea-fe75-4dc8-aec6-e11d87dd12b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Deleting offline snapshot ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] snapshot_file for this snap is: volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[04abfa9e-c641-4104-8246-a7696aef1beb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:05 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 Jul 10 05:47:05 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:06 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" returned: 0 in 0.913s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ab30ae-dcc5-48ce-9b93-2a58279878f6]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:06 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:06 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:07 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.865s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:07 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 Jul 10 05:47:07 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:07 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" returned: 0 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:07 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1 Jul 10 05:47:08 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:08 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" returned: 0 in 0.683s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-ac3955ea-fe75-4dc8-aec6-e11d87dd12b1" released by "_delete_snapshot" :: held 3.398s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" released by "delete_snapshot" :: held 3.429s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:08 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Created reservations ['5368ab83-0060-4ede-bd9a-e43109bd2f68', '19d3650c-7b70-4cd6-a985-e516847933c8', 'd480fc81-f4f1-4f3a-95d5-92a4a3666e6b', 'da487a73-3be0-46b0-a562-bfa40449fd7f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:47:08 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Delete snapshot completed successfully. Jul 10 05:47:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a7cd22f6-bd70-4be9-92f5-56232dca4440 tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-ac3955ea-fe75-4dc8-aec6-e11d87dd12b1-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Creating offline snapshot 787399e3-5094-4360-bfb5-e876502ca84b of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:47:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f4a760-b831-4868-94fc-ce279612d562]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:10 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:10 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:10 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.919s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:10 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b 1G Jul 10 05:47:10 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:11 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b 1G" returned: 0 in 1.097s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:11 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b Jul 10 05:47:11 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:12 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b" returned: 0 in 0.955s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:12 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b is being set with open permissions: ugo+rw Jul 10 05:47:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:12 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b Jul 10 05:47:12 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:13 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b" returned: 0 in 0.699s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.852s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.241s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:13 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fd745-818b-47b3-83e0-6df26b5689c4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:13 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f080833c-52f3-437d-bdc8-f346c3831357 tempest-SnapshotsActionsTest-35218742 None] Create snapshot completed successfully Jul 10 05:47:13 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 Jul 10 05:47:13 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-787399e3-5094-4360-bfb5-e876502ca84b-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-787399e3-5094-4360-bfb5-e876502ca84b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-787399e3-5094-4360-bfb5-e876502ca84b" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-787399e3-5094-4360-bfb5-e876502ca84b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Deleting offline snapshot 787399e3-5094-4360-bfb5-e876502ca84b of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] snapshot_file for this snap is: volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e315b2c-1065-49f4-aea5-5c3fb07ff1b2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:14 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b Jul 10 05:47:14 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:14 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" returned: 0 in 0.804s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8527a437-0d05-4d1d-aa2c-8414ddf2d2e3', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:47:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-0a9637d5-e83b-4d42-a0d5-1c3bd0f0f318 req-b580e9e5-bbb8-457e-ad9b-a5e58d5fef9a tempest-TaggedAttachmentsTest-66183136 None] attachment_update completed successfully. Jul 10 05:47:15 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b" returned: 0 in 0.902s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:15 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c8b16f-240a-43e7-8933-af50072fddf1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:15 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:15 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:16 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 0.971s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:16 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b Jul 10 05:47:16 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:17 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b" returned: 0 in 1.204s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:17 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b Jul 10 05:47:17 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:18 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.787399e3-5094-4360-bfb5-e876502ca84b" returned: 0 in 0.703s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-787399e3-5094-4360-bfb5-e876502ca84b" released by "_delete_snapshot" :: held 3.903s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" released by "delete_snapshot" :: held 3.936s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Created reservations ['eb36755e-7c0a-492e-b956-78297dd4cfd8', 'e4a4d1fd-0596-4199-a5f0-b48b29461ada', '2b577a43-35be-4a02-bc71-99b135aefdca', '2143ba39-2143-411b-97ec-c3b5e21b208a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:47:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Delete snapshot completed successfully. Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2f7475f1-8339-477d-8142-5c0f6d36f8cc tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-787399e3-5094-4360-bfb5-e876502ca84b-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Creating offline snapshot 60952ebc-45ee-4209-81b6-452d004a210a of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:47:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df6fc0-ff2e-4110-a198-f0646fb92e47]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:19 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:19 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:20 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 1.147s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:20 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a 1G Jul 10 05:47:20 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:21 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a 1G" returned: 0 in 1.230s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:21 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a Jul 10 05:47:21 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:22 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a" returned: 0 in 1.140s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:22 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a is being set with open permissions: ugo+rw Jul 10 05:47:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-d8a1da61-16d3-4aa5-a3f6-b21a83fd6c3b req-6368551a-e002-404a-b25c-00ddfad15998 tempest-TaggedAttachmentsTest-66183136 None] Terminate volume connection completed successfully. Jul 10 05:47:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-d8a1da61-16d3-4aa5-a3f6-b21a83fd6c3b req-6368551a-e002-404a-b25c-00ddfad15998 tempest-TaggedAttachmentsTest-66183136 None] Deleting attachment 8527a437-0d05-4d1d-aa2c-8414ddf2d2e3. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:47:22 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a Jul 10 05:47:22 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:23 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a" returned: 0 in 0.926s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:23 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=47,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:47:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.623s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d5df18cb-ecf1-486a-aaad-46846c6f1a3e tempest-SnapshotsActionsTest-35218742 None] Create snapshot completed successfully Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-60952ebc-45ee-4209-81b6-452d004a210a-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-60952ebc-45ee-4209-81b6-452d004a210a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Acquiring lock "cinder-quobyte-60952ebc-45ee-4209-81b6-452d004a210a" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-60952ebc-45ee-4209-81b6-452d004a210a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Deleting offline snapshot 60952ebc-45ee-4209-81b6-452d004a210a of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] snapshot_file for this snap is: volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e293400e-feb9-4057-afee-2f2ae5ed3daa]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:24 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a Jul 10 05:47:24 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:25 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a" returned: 0 in 1.127s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b9cc0-c483-4915-9430-affdc35b33e5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:25 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:25 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:26 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 1.062s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:26 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a Jul 10 05:47:26 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:27 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a" returned: 0 in 0.927s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:27 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a Jul 10 05:47:27 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:28 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.60952ebc-45ee-4209-81b6-452d004a210a" returned: 0 in 0.947s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-60952ebc-45ee-4209-81b6-452d004a210a" released by "_delete_snapshot" :: held 4.234s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" released by "delete_snapshot" :: held 4.271s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Created reservations ['ae76b51c-5078-453f-8023-1c0cfaa333e7', 'd90f8d7c-685a-4284-b74f-469978ca1001', '045f9842-e195-4357-8628-30ca726d489f', 'ab5579ef-18bb-494c-97b7-cbb3767bf318'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:28 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:47:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Delete snapshot completed successfully. Jul 10 05:47:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0811fa82-9f39-499d-ab23-1442aff4ee8a tempest-SnapshotsActionsTest-901860661 None] Lock "cinder-60952ebc-45ee-4209-81b6-452d004a210a-delete_snapshot" released by "delete_snapshot" :: held 4.538s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:28 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:30 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.319s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "cinder-8d000cf4-f5e9-4ada-8c3a-dc6e6343884e-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-8d000cf4-f5e9-4ada-8c3a-dc6e6343884e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "cinder-quobyte-8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-quobyte-8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Deleting offline snapshot 8d000cf4-f5e9-4ada-8c3a-dc6e6343884e of volume 9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] snapshot_file for this snap is: volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2637ae96-7d69-4067-a353-dce171ba08ab]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:31 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:31 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:32 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 1.347s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:47:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6737e76f-657e-4926-8c66-72fc90baf4c8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:32 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b Jul 10 05:47:32 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:33 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b" returned: 0 in 0.937s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:33 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:33 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:34 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 1.010s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:34 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e Jul 10 05:47:34 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:35 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b.8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" returned: 0 in 1.003s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-quobyte-8d000cf4-f5e9-4ada-8c3a-dc6e6343884e" released by "_delete_snapshot" :: held 4.497s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" released by "delete_snapshot" :: held 4.538s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:35 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Created reservations ['41be96e3-8a82-40c1-a470-5524858927cc', '4459cb96-a525-4267-9b00-79f1e4b7c5e5', '76c03c6c-e57f-4826-b8f3-684f0deb09cb', '8a065eaa-dd6d-482e-86ac-bfbae336db22'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:47:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Delete snapshot completed successfully. Jul 10 05:47:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596c19f3-0c19-4549-8fd5-0e862b27f94b tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-8d000cf4-f5e9-4ada-8c3a-dc6e6343884e-delete_snapshot" released by "delete_snapshot" :: held 4.729s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "cinder-9e9e6c72-d477-42d8-aa51-53d06cfa045b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-9e9e6c72-d477-42d8-aa51-53d06cfa045b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:36 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[233192e5-9a8b-4ba6-ab3f-9e8d62a297d5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:36 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b Jul 10 05:47:36 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:37 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b" returned: 0 in 1.171s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:37 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b Jul 10 05:47:37 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:38 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e9e6c72-d477-42d8-aa51-53d06cfa045b" returned: 0 in 0.777s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-quobyte-9e9e6c72-d477-42d8-aa51-53d06cfa045b" released by "delete_volume" :: held 2.058s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Created reservations ['44d1e642-5d58-498f-9068-b510f9924967', 'e44bbdac-c993-4cb5-a500-68b07bed5108', 'b06c35f6-ed01-4aaa-a539-dae3d86145c8', '23866f78-40d9-43ef-827b-444175e5d6e5'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:38 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:47:38 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:40 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.800s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:47:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Deleted volume successfully. Jul 10 05:47:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83baafa7-1330-42f4-a1a4-dcaf0bfa04df tempest-SnapshotsActionsTest-35218742 None] Lock "cinder-9e9e6c72-d477-42d8-aa51-53d06cfa045b-delete_volume" released by "delete_volume" :: held 4.173s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Acquiring lock "cinder-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Lock "cinder-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Acquiring lock "cinder-quobyte-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:47:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Lock "cinder-quobyte-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:47:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc4a032-f824-4dc9-a072-bc94735f4c42]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:47:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:47 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 Jul 10 05:47:47 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:48 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" returned: 0 in 1.643s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:48 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64 Jul 10 05:47:48 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:49 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" returned: 0 in 0.953s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Lock "cinder-quobyte-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64" released by "delete_volume" :: held 2.656s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Created reservations ['61945e0a-fbc9-4ced-b542-3596c6e31b43', 'a008f71d-e7e9-4b31-b554-4544b6ea5e8a', '0c7a6fb0-1557-4365-a331-58218f0c4f95', '2219863d-fa02-4c85-a4bc-464ba4a204ea'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:49 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:47:49 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:50 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.720s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:50 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:47:50 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Deleted volume successfully. Jul 10 05:47:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-073f1180-9cca-401a-8ad7-b0e0f2e92ee0 tempest-TaggedAttachmentsTest-66183136 None] Lock "cinder-a9dfe7e3-3c2d-44a8-ad56-2b068cba3a64-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:47:54 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:47:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Flow 'volume_create_manager' (48f47163-4a50-48e7-8a66-581872d3f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:47:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d19e20-8543-4560-bf94-484ec6d48eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d19e20-8543-4560-bf94-484ec6d48eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-870067737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778f3031-8785-4a39-8fc3-38416115234d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc43d6dac5040fe96c3b37444126df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:47:55Z,use_quota=True,user_id='6910ea60d73a4c199a181a92806529a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63ce687-cd82-4a67-82b6-725d3c0d7f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63ce687-cd82-4a67-82b6-725d3c0d7f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7b38d1-0e8e-4be8-b826-d7648aee9470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7b38d1-0e8e-4be8-b826-d7648aee9470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '778f3031-8785-4a39-8fc3-38416115234d', 'volume_name': 'volume-778f3031-8785-4a39-8fc3-38416115234d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e9e639-2432-4e82-90e7-22a7154933e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e9e639-2432-4e82-90e7-22a7154933e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3e7f01-5fbf-499a-b260-e504c1bc683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:55 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Volume 778f3031-8785-4a39-8fc3-38416115234d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-778f3031-8785-4a39-8fc3-38416115234d', 'volume_size': 1} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-870067737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778f3031-8785-4a39-8fc3-38416115234d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc43d6dac5040fe96c3b37444126df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:47:55Z,use_quota=True,user_id='6910ea60d73a4c199a181a92806529a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Creating volume 778f3031-8785-4a39-8fc3-38416115234d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:47:55 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:47:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:55 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d 1073741824 Jul 10 05:47:55 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:56 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d 1073741824" returned: 0 in 1.030s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:56 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d Jul 10 05:47:56 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:56 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d" returned: 0 in 0.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3e7f01-5fbf-499a-b260-e504c1bc683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-778f3031-8785-4a39-8fc3-38416115234d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5916e276-f043-4558-a600-ec573fc78338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:56 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Volume volume-778f3031-8785-4a39-8fc3-38416115234d (778f3031-8785-4a39-8fc3-38416115234d): created successfully Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5916e276-f043-4558-a600-ec573fc78338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Flow 'volume_create_manager' (48f47163-4a50-48e7-8a66-581872d3f04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:47:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-74db6d7e-c098-4d4d-bed7-1bad2675759e tempest-ServersNegativeTestJSON-2057378618 None] Created volume successfully. Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Flow 'volume_create_manager' (e445973a-b542-41d5-8106-07c36ac845f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d590fc-8828-408a-94b5-aeeb71a1b259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d590fc-8828-408a-94b5-aeeb71a1b259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-746789979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedf7a2b-e642-461f-95b7-34af0e8bc8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc43d6dac5040fe96c3b37444126df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:47:59Z,use_quota=True,user_id='6910ea60d73a4c199a181a92806529a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d372de-1b45-4257-97ac-5986500c92a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d372de-1b45-4257-97ac-5986500c92a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcff81a-9a42-477b-b3d8-5a811cf1fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfcff81a-9a42-477b-b3d8-5a811cf1fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedf7a2b-e642-461f-95b7-34af0e8bc8f7', 'volume_name': 'volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522d7ed8-d833-4998-8a2c-582d4e494512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522d7ed8-d833-4998-8a2c-582d4e494512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce422544-9f3f-414c-b8cd-ed829629a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:47:58 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Volume cedf7a2b-e642-461f-95b7-34af0e8bc8f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7', 'volume_size': 1} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-746789979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedf7a2b-e642-461f-95b7-34af0e8bc8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc43d6dac5040fe96c3b37444126df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:47:59Z,use_quota=True,user_id='6910ea60d73a4c199a181a92806529a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Creating volume cedf7a2b-e642-461f-95b7-34af0e8bc8f7 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:47:58 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:47:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:47:58 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 1073741824 Jul 10 05:47:58 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:47:59 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Jul 10 05:47:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 1073741824" returned: 0 in 1.096s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:00 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 Jul 10 05:48:00 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:00 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7" returned: 0 in 0.740s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce422544-9f3f-414c-b8cd-ed829629a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7426a69-2fb9-4728-ae78-4ee893a4b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:00 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Volume volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 (cedf7a2b-e642-461f-95b7-34af0e8bc8f7): created successfully Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7426a69-2fb9-4728-ae78-4ee893a4b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Flow 'volume_create_manager' (e445973a-b542-41d5-8106-07c36ac845f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:00 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4d87a60d-d1ff-4dd8-b2ef-b17d3993e515 tempest-ServersNegativeTestJSON-2057378618 None] Created volume successfully. Jul 10 05:48:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "cinder-cedf7a2b-e642-461f-95b7-34af0e8bc8f7-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-cedf7a2b-e642-461f-95b7-34af0e8bc8f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "cinder-quobyte-cedf7a2b-e642-461f-95b7-34af0e8bc8f7" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-quobyte-cedf7a2b-e642-461f-95b7-34af0e8bc8f7" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801810c-e9bd-4c5a-a71e-304b46dcbc38]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:01 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 Jul 10 05:48:01 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Flow 'volume_create_manager' (67d63b75-868d-44f1-ab60-61780c27f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f4b7de-a3f5-4aee-a070-9a86520a8a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f4b7de-a3f5-4aee-a070-9a86520a8a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-638122965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3e576e-f872-4018-b03c-14bf1b45cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bc3141dea740458d727976aafe4aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:02Z,use_quota=True,user_id='76c0ac2867b143c684dae215e3f1c327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a75d257-c08a-4228-bb0e-a5a9eb16a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a75d257-c08a-4228-bb0e-a5a9eb16a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b69efae-61a7-484c-8285-d553611aec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b69efae-61a7-484c-8285-d553611aec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3e576e-f872-4018-b03c-14bf1b45cd3a', 'volume_name': 'volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddeb372-889a-4d7d-b189-8d4c207185cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddeb372-889a-4d7d-b189-8d4c207185cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bd7d5e-752d-4fec-851d-66f74b6efc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:02 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Volume 4a3e576e-f872-4018-b03c-14bf1b45cd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a', 'volume_size': 1} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-638122965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3e576e-f872-4018-b03c-14bf1b45cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bc3141dea740458d727976aafe4aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:02Z,use_quota=True,user_id='76c0ac2867b143c684dae215e3f1c327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Creating volume 4a3e576e-f872-4018-b03c-14bf1b45cd3a {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:48:02 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:02 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a 1073741824 Jul 10 05:48:02 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:02 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7" returned: 0 in 0.891s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:02 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7 Jul 10 05:48:02 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:03 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a 1073741824" returned: 0 in 1.039s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:03 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a Jul 10 05:48:03 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:03 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cedf7a2b-e642-461f-95b7-34af0e8bc8f7" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-quobyte-cedf7a2b-e642-461f-95b7-34af0e8bc8f7" released by "delete_volume" :: held 1.861s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Flow 'volume_create_manager' (8a9b0de0-018c-4d60-ab38-cb36ce6e973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ef7ceb-023e-4756-9eae-b77d8eb0c7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Created reservations ['ccdd7955-7290-4f14-b687-b7e6f7df33a3', '5e11cf53-d927-4adc-a5bc-ab147695797d', 'dcdac9d7-c632-46a4-8f05-1c98f241335a', '913c4631-9786-45d8-8d14-0ba16486fa5f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ef7ceb-023e-4756-9eae-b77d8eb0c7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1238400449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef3c13b0d994258a5fef6fb15f00b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:03Z,use_quota=True,user_id='a73e8336435040d3957397432dac86dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9232ec4f-4a67-4420-9820-affdd3aee107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9232ec4f-4a67-4420-9820-affdd3aee107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daf217a-d16d-4dcf-8021-23518622d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daf217a-d16d-4dcf-8021-23518622d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804', 'volume_name': 'volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b77897c-3622-4639-90f0-6fa8e2ba6337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b77897c-3622-4639-90f0-6fa8e2ba6337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7306e1e5-c74b-4741-bb3e-f69dabd8061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:03 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Volume 671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804', 'volume_size': 1} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:03 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:48:03 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:04 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.239s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1238400449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef3c13b0d994258a5fef6fb15f00b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:03Z,use_quota=True,user_id='a73e8336435040d3957397432dac86dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Creating volume 671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:48:04 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bd7d5e-752d-4fec-851d-66f74b6efc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:04 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 1073741824 Jul 10 05:48:04 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cbed02-80b8-4bc9-9917-9b3f2394bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:04 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Volume volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a (4a3e576e-f872-4018-b03c-14bf1b45cd3a): created successfully Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cbed02-80b8-4bc9-9917-9b3f2394bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Flow 'volume_create_manager' (67d63b75-868d-44f1-ab60-61780c27f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c201c5d3-5d45-4380-8f46-bbf0b877ee63 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Created volume successfully. Jul 10 05:48:04 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:48:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Deleted volume successfully. Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bef04097-0ec1-42cf-a059-782ded26e156 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-cedf7a2b-e642-461f-95b7-34af0e8bc8f7-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "cinder-778f3031-8785-4a39-8fc3-38416115234d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-778f3031-8785-4a39-8fc3-38416115234d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=3,cinder:SELECT=57,cinder:INSERT=13,cinder:UPDATE=61 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:48:04 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 1073741824" returned: 0 in 0.950s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "cinder-quobyte-778f3031-8785-4a39-8fc3-38416115234d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-quobyte-778f3031-8785-4a39-8fc3-38416115234d" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0d69a7-0194-4337-95fa-0eaa92e6a189]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:05 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 Jul 10 05:48:05 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:05 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d Jul 10 05:48:05 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "cinder-4a3e576e-f872-4018-b03c-14bf1b45cd3a-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "cinder-4a3e576e-f872-4018-b03c-14bf1b45cd3a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "cinder-quobyte-4a3e576e-f872-4018-b03c-14bf1b45cd3a" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "cinder-quobyte-4a3e576e-f872-4018-b03c-14bf1b45cd3a" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c101a7-687d-4561-a499-dac1f07ba8a3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:05 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a Jul 10 05:48:05 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:05 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" returned: 0 in 0.837s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7306e1e5-c74b-4741-bb3e-f69dabd8061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c31953-bb90-4e58-9648-3002c19e3a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Volume volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 (671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804): created successfully Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c31953-bb90-4e58-9648-3002c19e3a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Flow 'volume_create_manager' (8a9b0de0-018c-4d60-ab38-cb36ce6e973c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-fc17fd63-7ca3-4919-8978-3da7f918f447 tempest-AttachVolumeNegativeTest-1090633536 None] Created volume successfully. Jul 10 05:48:05 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d" returned: 0 in 0.960s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:06 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d Jul 10 05:48:06 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:06 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a" returned: 0 in 1.096s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:06 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a Jul 10 05:48:06 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:06 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-778f3031-8785-4a39-8fc3-38416115234d" returned: 0 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-quobyte-778f3031-8785-4a39-8fc3-38416115234d" released by "delete_volume" :: held 1.841s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:06 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Created reservations ['51ae6567-31ff-4890-b37a-2240ead1f053', 'c5327920-d4cc-4160-9a6d-d098d41cdfe0', 'aba3613a-99f7-4194-8a20-dae6a6cc2775', '40b222c4-f827-492f-ab15-bd979ef4407f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:07 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:48:07 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:07 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4a3e576e-f872-4018-b03c-14bf1b45cd3a" returned: 0 in 1.101s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "cinder-quobyte-4a3e576e-f872-4018-b03c-14bf1b45cd3a" released by "delete_volume" :: held 2.290s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:07 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Created reservations ['62e9da7b-c549-4c6c-932c-8da0be1533a3', '31591d2d-5f91-4869-97c0-540a4794d7c9', '7833a8b7-48f6-4527-bdd5-da3e7c2e0850', 'c182f861-0a4b-4b70-8a5d-622a0985169a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:08 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:48:08 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:08 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.056s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:48:08 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Deleted volume successfully. Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5129825-db17-410a-bd94-3d67ef63f661 tempest-ServersNegativeTestJSON-2057378618 None] Lock "cinder-778f3031-8785-4a39-8fc3-38416115234d-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:08 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:48:08 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Deleted volume successfully. Jul 10 05:48:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-440c4d16-46da-44c7-b384-be819747d75f tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "cinder-4a3e576e-f872-4018-b03c-14bf1b45cd3a-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Flow 'volume_create_manager' (33e542b5-5554-4487-ad8e-e02c191cec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0311e45d-b10e-46e6-90c2-502bbf586f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0311e45d-b10e-46e6-90c2-502bbf586f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1786192422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0598ae-b268-491e-960d-7502e55f292e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bc3141dea740458d727976aafe4aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:10Z,use_quota=True,user_id='76c0ac2867b143c684dae215e3f1c327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58ea6a2-4255-4401-a65c-d62fbee839cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58ea6a2-4255-4401-a65c-d62fbee839cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b243ee-2b45-4c9c-a902-d9f5e62d5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b243ee-2b45-4c9c-a902-d9f5e62d5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0598ae-b268-491e-960d-7502e55f292e', 'volume_name': 'volume-4d0598ae-b268-491e-960d-7502e55f292e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5940df33-7b17-480a-8e0f-9eed9a098429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5940df33-7b17-480a-8e0f-9eed9a098429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b220ce90-627b-4bfe-84a4-f61be83c5de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:09 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Volume 4d0598ae-b268-491e-960d-7502e55f292e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0598ae-b268-491e-960d-7502e55f292e', 'volume_size': 1} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1786192422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0598ae-b268-491e-960d-7502e55f292e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bc3141dea740458d727976aafe4aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:10Z,use_quota=True,user_id='76c0ac2867b143c684dae215e3f1c327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Creating volume 4d0598ae-b268-491e-960d-7502e55f292e {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:48:09 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:48:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:09 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e 1073741824 Jul 10 05:48:09 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:10 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e 1073741824" returned: 0 in 1.110s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:11 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e Jul 10 05:48:11 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:11 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b220ce90-627b-4bfe-84a4-f61be83c5de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0598ae-b268-491e-960d-7502e55f292e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caba3b46-4187-4f9d-865e-9d960815b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f7c4c-c633-47a8-bb12-b3906c7dff55]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:11 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Volume volume-4d0598ae-b268-491e-960d-7502e55f292e (4d0598ae-b268-491e-960d-7502e55f292e): created successfully Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caba3b46-4187-4f9d-865e-9d960815b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Flow 'volume_create_manager' (33e542b5-5554-4487-ad8e-e02c191cec56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-39b2af55-3e2c-4e88-99a2-d615ea971976 tempest-VolumeQuotasAdminTestJSON-1510641060 None] Created volume successfully. Jul 10 05:48:11 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 Jul 10 05:48:11 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:12 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" returned: 0 in 0.838s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.878s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94418e28-5495-4b6b-add1-9401bc104aa4', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:48:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-f7b421c6-46f2-4d52-8539-530331645ed6 req-e3b618ad-2a02-436c-bf1d-55853e9147ae tempest-AttachVolumeNegativeTest-1090633536 None] attachment_update completed successfully. Jul 10 05:48:13 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8f6ecae4-85c2-4993-8830-b1784b83aa7b tempest-VolumeQuotasAdminTestJSON-1655755749 None] Transfer volume completed successfully. Jul 10 05:48:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Acquiring lock "cinder-4d0598ae-b268-491e-960d-7502e55f292e-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Lock "cinder-4d0598ae-b268-491e-960d-7502e55f292e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Acquiring lock "cinder-quobyte-4d0598ae-b268-491e-960d-7502e55f292e" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Lock "cinder-quobyte-4d0598ae-b268-491e-960d-7502e55f292e" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:14 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3d3ea9-8583-46dd-8f89-525a5d083fb0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:14 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e Jul 10 05:48:14 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:15 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e" returned: 0 in 0.797s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:15 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e Jul 10 05:48:15 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:16 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4d0598ae-b268-491e-960d-7502e55f292e" returned: 0 in 0.756s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Lock "cinder-quobyte-4d0598ae-b268-491e-960d-7502e55f292e" released by "delete_volume" :: held 1.602s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Created reservations ['82929b1b-80bb-4032-8086-ea11b659aa1b', '1728ef9b-f30c-41be-bf70-93baba88c782', '9745ab36-e11d-4db3-8d04-99841f76c336', '275f7d8e-3eaf-4c32-bcb9-b39f63610829'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:16 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:48:16 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:17 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.858s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:17 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:48:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Deleted volume successfully. Jul 10 05:48:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-34665f57-b7ec-490c-83c9-86d160091c95 tempest-VolumeQuotasAdminTestJSON-907975194 None] Lock "cinder-4d0598ae-b268-491e-960d-7502e55f292e-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=32,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=9,cinder:SELECT=59,cinder:INSERT=19,cinder:UPDATE=73 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Flow 'volume_create_manager' (234e0e69-f6be-4d44-ab6f-084028678401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff2a543-a3aa-45fb-b7d5-c32e2be68a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff2a543-a3aa-45fb-b7d5-c32e2be68a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1990733704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798d1547-d158-414a-9db1-0025c3258a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01f3a6711bc4cba97d6be7a7b6e8c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:27Z,use_quota=True,user_id='5c4f2dcb010c4e129917adcbe26fec12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff7f9aff-2617-40ea-b214-606ee1ab0d91),volume_type_id=ff7f9aff-2617-40ea-b214-606ee1ab0d91)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa2725d-7ac3-4150-955a-ff56b2464110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa2725d-7ac3-4150-955a-ff56b2464110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a40c7de-0bb9-4dc6-aeaf-8931a3d05f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a40c7de-0bb9-4dc6-aeaf-8931a3d05f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798d1547-d158-414a-9db1-0025c3258a57', 'volume_name': 'volume-798d1547-d158-414a-9db1-0025c3258a57', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a6806c-233e-49de-8107-9a004776c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a6806c-233e-49de-8107-9a004776c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9684032-a3d0-4677-9dc2-ec83482cc01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Volume 798d1547-d158-414a-9db1-0025c3258a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798d1547-d158-414a-9db1-0025c3258a57', 'volume_size': 1} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1990733704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798d1547-d158-414a-9db1-0025c3258a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01f3a6711bc4cba97d6be7a7b6e8c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:27Z,use_quota=True,user_id='5c4f2dcb010c4e129917adcbe26fec12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff7f9aff-2617-40ea-b214-606ee1ab0d91),volume_type_id=ff7f9aff-2617-40ea-b214-606ee1ab0d91)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Creating volume 798d1547-d158-414a-9db1-0025c3258a57 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:48:26 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:48:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:26 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 1073741824 Jul 10 05:48:26 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:27 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 1073741824" returned: 0 in 1.070s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:28 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 Jul 10 05:48:28 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:28 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57" returned: 0 in 0.785s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9684032-a3d0-4677-9dc2-ec83482cc01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798d1547-d158-414a-9db1-0025c3258a57', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bae9407-30ed-408e-8cca-e722845e249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:28 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Volume volume-798d1547-d158-414a-9db1-0025c3258a57 (798d1547-d158-414a-9db1-0025c3258a57): created successfully Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bae9407-30ed-408e-8cca-e722845e249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Flow 'volume_create_manager' (234e0e69-f6be-4d44-ab6f-084028678401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3190a97e-5ed6-493a-8785-a81f9ba80ce3 tempest-VolumeTypesAccessTest-1004245400 None] Created volume successfully. Jul 10 05:48:28 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:48:28 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:29 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.982s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:48:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Acquiring lock "cinder-798d1547-d158-414a-9db1-0025c3258a57-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Lock "cinder-798d1547-d158-414a-9db1-0025c3258a57-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Acquiring lock "cinder-quobyte-798d1547-d158-414a-9db1-0025c3258a57" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:48:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Lock "cinder-quobyte-798d1547-d158-414a-9db1-0025c3258a57" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:48:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afb423b-b400-404a-b547-2b7a3b29bdb5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:30 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 Jul 10 05:48:30 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:31 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57" returned: 0 in 0.977s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:31 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57 Jul 10 05:48:31 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:32 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-798d1547-d158-414a-9db1-0025c3258a57" returned: 0 in 0.849s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Lock "cinder-quobyte-798d1547-d158-414a-9db1-0025c3258a57" released by "delete_volume" :: held 1.933s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:32 devstack cinder-volume[87449]: WARNING cinder.quota [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1487089761 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1487089761, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:48:32 devstack cinder-volume[87449]: WARNING cinder.quota [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1487089761 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1487089761, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Created reservations ['3d36ef60-afa3-4baf-be4b-584bd5d27cae', '3704ade1-d583-4f3e-8101-b312df1621af', 'cada9d53-f0c0-44f8-9f66-7f717cb2dee2', 'e286ca80-f4d4-4add-b033-3b6e69bd1f8c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:48:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:32 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:48:32 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:33 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.277s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:33 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:48:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Deleted volume successfully. Jul 10 05:48:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ca19fbd-e78f-4ce7-b868-7735c5a8174b tempest-VolumeTypesAccessTest-1004245400 None] Lock "cinder-798d1547-d158-414a-9db1-0025c3258a57-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:48:42 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:48:43 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Flow 'volume_create_manager' (db5ae1df-e726-454a-982b-cc11b394635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5d8ab5-0e75-4faf-938c-fe1148162832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5d8ab5-0e75-4faf-938c-fe1148162832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1372089541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0153e4df-265b-474e-9132-3f6911d3c08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afaabbee0284046bb721110e6fbdc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:57Z,use_quota=True,user_id='be0de47a2fb84c8da14989773e80e63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6724b508-0192-46cc-beea-6cc3ae94fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6724b508-0192-46cc-beea-6cc3ae94fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe55be30-e9b9-4960-8cd1-4cdc7695d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe55be30-e9b9-4960-8cd1-4cdc7695d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0153e4df-265b-474e-9132-3f6911d3c08c', 'volume_name': 'volume-0153e4df-265b-474e-9132-3f6911d3c08c', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791adf14-629d-425c-8be6-bcd5778cb43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791adf14-629d-425c-8be6-bcd5778cb43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d99c6-1cab-47c6-a31f-01f7ecdd1e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:48:57 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Volume 0153e4df-265b-474e-9132-3f6911d3c08c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0153e4df-265b-474e-9132-3f6911d3c08c', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 05:48:57 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Trying to clone 0153e4df-265b-474e-9132-3f6911d3c08c from image b4e08d22-7293-452f-a208-7a340b669863 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 05:48:58 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 05:48:58 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Image download 20.69 MB at 20.69 MB/s Jul 10 05:48:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af35b61-bd20-49fc-b05c-f72706278534]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:58 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD Jul 10 05:48:58 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:48:59 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 10 05:48:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:48:59 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 is fetched for user be0de47a2fb84c8da14989773e80e63a. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 05:48:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e32ce5-cce0-4e43-8fdf-d577ff4af813]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:48:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:48:59 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD Jul 10 05:48:59 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Flow 'volume_create_manager' (64b80232-e741-4c73-8039-ea970845f5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7db1e7-e18d-4045-b505-35f5ee29bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7db1e7-e18d-4045-b505-35f5ee29bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-394240283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61964ff3-2ea5-405f-b0f2-332ee763dff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194fc1dd6d9648f899e138b4af122fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:00Z,use_quota=True,user_id='4a2339a0a6764c76821fe003f57bfdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2067cb-04b8-4736-a93d-d2180c58caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2067cb-04b8-4736-a93d-d2180c58caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc40492-eb8a-4155-93fc-0399e27f1ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc40492-eb8a-4155-93fc-0399e27f1ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61964ff3-2ea5-405f-b0f2-332ee763dff7', 'volume_name': 'volume-61964ff3-2ea5-405f-b0f2-332ee763dff7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6c5594-c3f3-4865-9957-905687759916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6c5594-c3f3-4865-9957-905687759916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb2ff5a-e31c-406f-97c4-abc1b6042218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:00 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Volume 61964ff3-2ea5-405f-b0f2-332ee763dff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61964ff3-2ea5-405f-b0f2-332ee763dff7', 'volume_size': 1} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-394240283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61964ff3-2ea5-405f-b0f2-332ee763dff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194fc1dd6d9648f899e138b4af122fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:00Z,use_quota=True,user_id='4a2339a0a6764c76821fe003f57bfdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Creating volume 61964ff3-2ea5-405f-b0f2-332ee763dff7 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:49:00 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:00 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 1073741824 Jul 10 05:49:00 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:00 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD" returned: 0 in 1.440s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:01 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 1073741824" returned: 0 in 1.435s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:01 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 Jul 10 05:49:01 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:02 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7" returned: 0 in 0.894s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.935s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1372089541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0153e4df-265b-474e-9132-3f6911d3c08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afaabbee0284046bb721110e6fbdc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:48:57Z,use_quota=True,user_id='be0de47a2fb84c8da14989773e80e63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Creating volume 0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:49:02 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:02 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c 1073741824 Jul 10 05:49:02 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb2ff5a-e31c-406f-97c4-abc1b6042218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61964ff3-2ea5-405f-b0f2-332ee763dff7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2343eac6-c94b-45c3-a8ff-ccaca6a92aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:02 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Volume volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 (61964ff3-2ea5-405f-b0f2-332ee763dff7): created successfully Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2343eac6-c94b-45c3-a8ff-ccaca6a92aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Flow 'volume_create_manager' (64b80232-e741-4c73-8039-ea970845f5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1432232b-4ce4-4a87-996f-b7235f1a3ecc tempest-ServerActionsTestOtherA-1163121724 None] Created volume successfully. Jul 10 05:49:03 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c 1073741824" returned: 0 in 0.993s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:03 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:03 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:04 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 0 in 0.776s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:49:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:04 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Attempting download of b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume 0153e4df-265b-474e-9132-3f6911d3c08c. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 05:49:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48802b7-5d9a-482e-8168-0e466aecf577]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:04 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx Jul 10 05:49:04 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:05 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx" returned: 0 in 0.823s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:05 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx Jul 10 05:49:05 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:06 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx" returned: 1 in 0.791s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_hqy1devx' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:49:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b53f54-7b20-4e75-8e04-d8862bad0109]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:06 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD Jul 10 05:49:06 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:07 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD" returned: 0 in 1.085s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:07 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] b4e08d22-7293-452f-a208-7a340b669863 was qcow2, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 05:49:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:07 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:07 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:09 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 0 in 2.215s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:09 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_rq69r_vldevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:49:09 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Converted 112.00 MB image at 50.52 MB/s Jul 10 05:49:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:09 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c 1G Jul 10 05:49:09 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:10 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c 1G" returned: 0 in 0.874s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:10 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[001902a6-1a0d-4440-b8cd-f933d68e71b4]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:10 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:10 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:11 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 0 in 0.901s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:11 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:11 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:12 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 1 in 0.762s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Downloaded image b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume 0153e4df-265b-474e-9132-3f6911d3c08c successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 for user be0de47a2fb84c8da14989773e80e63a is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Marking volume 0153e4df-265b-474e-9132-3f6911d3c08c as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Copying metadata from image b4e08d22-7293-452f-a208-7a340b669863 to 0153e4df-265b-474e-9132-3f6911d3c08c. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Creating volume glance metadata for volume 0153e4df-265b-474e-9132-3f6911d3c08c backed by image b4e08d22-7293-452f-a208-7a340b669863 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d99c6-1cab-47c6-a31f-01f7ecdd1e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0153e4df-265b-474e-9132-3f6911d3c08c', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161cf3ce-f643-4260-a0f5-2e4b56f42fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Volume volume-0153e4df-265b-474e-9132-3f6911d3c08c (0153e4df-265b-474e-9132-3f6911d3c08c): created successfully Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161cf3ce-f643-4260-a0f5-2e4b56f42fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Flow 'volume_create_manager' (db5ae1df-e726-454a-982b-cc11b394635f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-05df1f89-51ef-455f-9fd3-432c6eadffd4 tempest-VolumesImageMetadata-406565369 None] Created volume successfully. Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Acquiring lock "cinder-0153e4df-265b-474e-9132-3f6911d3c08c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Lock "cinder-0153e4df-265b-474e-9132-3f6911d3c08c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Acquiring lock "cinder-quobyte-0153e4df-265b-474e-9132-3f6911d3c08c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Lock "cinder-quobyte-0153e4df-265b-474e-9132-3f6911d3c08c" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:13 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[215c5aaf-fd94-49ca-b674-a930610b42b6]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:13 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:13 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:13 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 0 in 0.781s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:13 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:13 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 1 in 0.735s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:49:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:14 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:14 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c Jul 10 05:49:14 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-7a2e54cc-db57-4e05-8f40-eaccba573e52 req-b2a2ec1d-9370-49c8-a436-6ae80c005f35 tempest-AttachVolumeNegativeTest-1090633536 None] Terminate volume connection completed successfully. Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-7a2e54cc-db57-4e05-8f40-eaccba573e52 req-b2a2ec1d-9370-49c8-a436-6ae80c005f35 tempest-AttachVolumeNegativeTest-1090633536 None] Deleting attachment 94418e28-5495-4b6b-add1-9401bc104aa4. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:49:15 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0153e4df-265b-474e-9132-3f6911d3c08c" returned: 0 in 0.868s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Lock "cinder-quobyte-0153e4df-265b-474e-9132-3f6911d3c08c" released by "delete_volume" :: held 2.448s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Created reservations ['7c9679e3-908a-4912-9869-2b6d018176aa', '2892d32e-9d0b-44d2-b417-9d31e55a749a', '38206032-5501-4ddf-83a3-42d401e25fc2', '97cd442e-4df9-4167-99da-fb981bda2b05'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:15 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:49:15 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:16 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.674s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:16 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:49:16 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Deleted volume successfully. Jul 10 05:49:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-596a2cd1-cc56-46e0-b610-48e23cea9794 tempest-VolumesImageMetadata-406565369 None] Lock "cinder-0153e4df-265b-474e-9132-3f6911d3c08c-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Flow 'volume_create_manager' (1edcba84-ade3-4b69-9251-93917a3a323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358b609c-69bb-4c38-83a6-0b40c014fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358b609c-69bb-4c38-83a6-0b40c014fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-776685307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72547676-66fc-4e30-84a8-2c2786daa02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c50db5f842428d9d2e6fc78a7c725e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:23Z,use_quota=True,user_id='3f8f5f97266444cb91edf267e67f8e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69312b76-5dbb-4fb7-950e-7e926cfb6052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69312b76-5dbb-4fb7-950e-7e926cfb6052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6508a8-6b68-4270-a656-325a1ec2a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6508a8-6b68-4270-a656-325a1ec2a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72547676-66fc-4e30-84a8-2c2786daa02f', 'volume_name': 'volume-72547676-66fc-4e30-84a8-2c2786daa02f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9195f3-f1da-4da7-9beb-9f1bb69c15a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9195f3-f1da-4da7-9beb-9f1bb69c15a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0a8c34-3622-4b3f-8610-4af7201dd57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:22 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Volume 72547676-66fc-4e30-84a8-2c2786daa02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72547676-66fc-4e30-84a8-2c2786daa02f', 'volume_size': 1} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-776685307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72547676-66fc-4e30-84a8-2c2786daa02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c50db5f842428d9d2e6fc78a7c725e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:23Z,use_quota=True,user_id='3f8f5f97266444cb91edf267e67f8e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Creating volume 72547676-66fc-4e30-84a8-2c2786daa02f {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:49:22 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:49:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:22 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f 1073741824 Jul 10 05:49:22 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:23 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f 1073741824" returned: 0 in 1.211s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:24 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f Jul 10 05:49:24 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:24 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f" returned: 0 in 0.757s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0a8c34-3622-4b3f-8610-4af7201dd57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72547676-66fc-4e30-84a8-2c2786daa02f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aac31d0-9975-426a-8fb7-c2cb3bc239a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Volume volume-72547676-66fc-4e30-84a8-2c2786daa02f (72547676-66fc-4e30-84a8-2c2786daa02f): created successfully Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aac31d0-9975-426a-8fb7-c2cb3bc239a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Flow 'volume_create_manager' (1edcba84-ade3-4b69-9251-93917a3a323a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1f12bb0b-5c94-4675-a881-5dba19d1804e tempest-AttachVolumeTestJSON-1551329018 None] Created volume successfully. Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Flow 'volume_create_manager' (f81d3802-d8b8-40fb-9f82-85ba560ad80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6c7030-a6fb-4957-a4cd-69cdbdef6c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6c7030-a6fb-4957-a4cd-69cdbdef6c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-594269083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abac86e6-494d-4bee-86c5-fe8068ae5088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cab16005e8c8439f915e5966c87038ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:26Z,use_quota=True,user_id='d5c17167637a47379c19c7ac6b3d71ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b4b054-40ec-48e0-9208-6c8e5cdd6b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b4b054-40ec-48e0-9208-6c8e5cdd6b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe18c13b-39fb-4860-a49a-f56b6bc6fc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe18c13b-39fb-4860-a49a-f56b6bc6fc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abac86e6-494d-4bee-86c5-fe8068ae5088', 'volume_name': 'volume-abac86e6-494d-4bee-86c5-fe8068ae5088', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81165e57-e215-4a99-a924-9359a31799f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81165e57-e215-4a99-a924-9359a31799f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd6bd70-7588-4ad4-a3e7-6b495ba7a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:25 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Volume abac86e6-494d-4bee-86c5-fe8068ae5088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abac86e6-494d-4bee-86c5-fe8068ae5088', 'volume_size': 1} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-594269083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abac86e6-494d-4bee-86c5-fe8068ae5088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cab16005e8c8439f915e5966c87038ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:26Z,use_quota=True,user_id='d5c17167637a47379c19c7ac6b3d71ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Creating volume abac86e6-494d-4bee-86c5-fe8068ae5088 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:49:25 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:49:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:25 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 1073741824 Jul 10 05:49:25 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:26 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 1073741824" returned: 0 in 1.093s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:26 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 Jul 10 05:49:26 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:27 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088" returned: 0 in 0.703s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd6bd70-7588-4ad4-a3e7-6b495ba7a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abac86e6-494d-4bee-86c5-fe8068ae5088', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaba9b0-800b-4c43-8e4b-0f948dd21080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:27 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Volume volume-abac86e6-494d-4bee-86c5-fe8068ae5088 (abac86e6-494d-4bee-86c5-fe8068ae5088): created successfully Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaba9b0-800b-4c43-8e4b-0f948dd21080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Flow 'volume_create_manager' (f81d3802-d8b8-40fb-9f82-85ba560ad80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c149708c-358f-4d55-87f3-f288ca10c5d1 tempest-AbsoluteLimitsTests-1985211378 None] Created volume successfully. Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:28 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:49:28 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Acquiring lock "cinder-abac86e6-494d-4bee-86c5-fe8068ae5088-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Lock "cinder-abac86e6-494d-4bee-86c5-fe8068ae5088-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c657f984-f96d-4fb8-97cf-0faf5eee957b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Acquiring lock "cinder-quobyte-abac86e6-494d-4bee-86c5-fe8068ae5088" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Lock "cinder-quobyte-abac86e6-494d-4bee-86c5-fe8068ae5088" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[be247708-69f0-412e-98ba-01b2fe8652b3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:29 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f Jul 10 05:49:29 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:29 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 Jul 10 05:49:29 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:29 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.003s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:49:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:49:30 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088" returned: 0 in 1.074s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:30 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088 Jul 10 05:49:30 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:30 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f" returned: 0 in 1.293s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.326s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-72547676-66fc-4e30-84a8-2c2786daa02f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c81460b0-4e8e-4925-92ba-18260ab5022b', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:49:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-485beb7a-49b6-475e-9b32-3d5c122da11d req-b7ca907e-dcb1-4d55-a678-0fb025f6a711 tempest-AttachVolumeTestJSON-1551329018 None] attachment_update completed successfully. Jul 10 05:49:31 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-abac86e6-494d-4bee-86c5-fe8068ae5088" returned: 0 in 0.682s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Lock "cinder-quobyte-abac86e6-494d-4bee-86c5-fe8068ae5088" released by "delete_volume" :: held 1.813s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Created reservations ['555b82d8-9006-4379-a296-12555005dd57', 'd3631d73-a700-4f2e-994c-ac2246870075', 'e0eee88d-86b7-4f52-9298-6a00e747723d', 'aee0fed0-05dc-45dc-afea-a275361f1125'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:31 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:49:31 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:31 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:49:31 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Deleted volume successfully. Jul 10 05:49:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c6c7163-1092-4c50-af71-81c40d735e22 tempest-AbsoluteLimitsTests-1985211378 None] Lock "cinder-abac86e6-494d-4bee-86c5-fe8068ae5088-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Flow 'volume_create_manager' (3b6c5c15-7125-4e1c-a06a-d2fe8304ede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d6c248-138e-4f67-9780-22fc77155d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d6c248-138e-4f67-9780-22fc77155d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1372003021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f37e9b9-69d9-4028-be59-ecc85711f0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd4b3674ec46e2831c0ff0b56a24e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:35Z,use_quota=True,user_id='2af89f5ecc73432898c32d1836d98bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6101d98b-f2e2-41fd-8a23-73daa28302b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6101d98b-f2e2-41fd-8a23-73daa28302b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e302c898-a212-4a3b-aaff-fd5d5d03de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e302c898-a212-4a3b-aaff-fd5d5d03de0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f37e9b9-69d9-4028-be59-ecc85711f0d9', 'volume_name': 'volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bc519-6569-4557-8a48-da714eb66e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043bc519-6569-4557-8a48-da714eb66e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c05066-04e3-46e2-8180-7e14bd0d3b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Volume 7f37e9b9-69d9-4028-be59-ecc85711f0d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9', 'volume_size': 1} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1372003021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f37e9b9-69d9-4028-be59-ecc85711f0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd4b3674ec46e2831c0ff0b56a24e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:49:35Z,use_quota=True,user_id='2af89f5ecc73432898c32d1836d98bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Creating volume 7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:49:35 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:49:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:35 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 1073741824 Jul 10 05:49:35 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:36 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 1073741824" returned: 0 in 0.947s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:36 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 Jul 10 05:49:36 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:37 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9" returned: 0 in 0.904s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c05066-04e3-46e2-8180-7e14bd0d3b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c401580-b538-476c-be8d-40d37f6a1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:49:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Volume volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 (7f37e9b9-69d9-4028-be59-ecc85711f0d9): created successfully Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c401580-b538-476c-be8d-40d37f6a1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:49:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Flow 'volume_create_manager' (3b6c5c15-7125-4e1c-a06a-d2fe8304ede4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:49:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e41f3de3-a9f5-4791-af33-9c14434ba34c tempest-VolumesDeleteCascade-1218680636 None] Created volume successfully. Jul 10 05:49:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Creating offline snapshot b855c8b6-3809-4c79-8fa6-664626137647 of volume 7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:49:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b70ab-7992-45b1-8296-fb1c4d19b3d1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:38 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 Jul 10 05:49:38 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:39 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9" returned: 0 in 0.783s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:39 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 1G Jul 10 05:49:39 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:40 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 1G" returned: 0 in 0.988s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:40 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:40 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:41 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 0.883s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:41 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 is being set with open permissions: ugo+rw Jul 10 05:49:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:41 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:41 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:42 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 0.653s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:42 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info Jul 10 05:49:42 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:42 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info" returned: 0 in 0.697s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:42 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info is being set with open permissions: ugo+rw Jul 10 05:49:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:42 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info Jul 10 05:49:42 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:43 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.info" returned: 0 in 0.645s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.769s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-bf535862-8231-477c-a0d4-07bd72ef3b46 tempest-VolumesDeleteCascade-1218680636 None] Create snapshot completed successfully Jul 10 05:49:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Creating offline snapshot 015ac6df-6424-43a0-a13f-ea9f268a0f56 of volume 7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:49:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c75da67-fb58-4efb-b3c8-a673effc90dd]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:44 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:44 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:49:45 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 1.136s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:49:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:45 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 1G Jul 10 05:49:45 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:46 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 1G" returned: 0 in 0.950s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:46 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 Jul 10 05:49:46 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:47 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:47 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 is being set with open permissions: ugo+rw Jul 10 05:49:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:47 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 Jul 10 05:49:47 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:48 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56" returned: 0 in 1.178s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.241s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:49:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4302f-2067-474a-a21e-aea7cb4b3181]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a7825faa-f1bd-4e24-9487-b913122ca8ae tempest-VolumesDeleteCascade-1218680636 None] Create snapshot completed successfully Jul 10 05:49:49 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 Jul 10 05:49:49 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-7f37e9b9-69d9-4028-be59-ecc85711f0d9-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-7f37e9b9-69d9-4028-be59-ecc85711f0d9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Performing cascade delete. {{(pid=87449) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-015ac6df-6424-43a0-a13f-ea9f268a0f56-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-015ac6df-6424-43a0-a13f-ea9f268a0f56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-015ac6df-6424-43a0-a13f-ea9f268a0f56" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-015ac6df-6424-43a0-a13f-ea9f268a0f56" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Deleting offline snapshot 015ac6df-6424-43a0-a13f-ea9f268a0f56 of volume 7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] snapshot_file for this snap is: volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7612c59-32de-4b16-804b-f5ace37fc0bc]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:50 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7" returned: 0 in 1.538s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.580s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:49:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-61964ff3-2ea5-405f-b0f2-332ee763dff7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2dd3f53-fc61-4393-bccb-5f6437068e44', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:49:50 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 Jul 10 05:49:50 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:50 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-da6031af-cdc2-468d-b57c-51b4f6f01a7e req-c784b0b2-e10f-42ce-b1e2-6a1b5b0fc2de tempest-ServerActionsTestOtherA-1163121724 None] attachment_update completed successfully. Jul 10 05:49:51 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56" returned: 0 in 1.174s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:49:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d6a6a-b62d-41b8-bbde-a9ab872a2c3d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:51 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:51 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:52 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 0.861s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:49:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:52 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 Jul 10 05:49:52 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:53 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56" returned: 0 in 0.800s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:53 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56 Jul 10 05:49:53 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:53 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.015ac6df-6424-43a0-a13f-ea9f268a0f56" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-015ac6df-6424-43a0-a13f-ea9f268a0f56" released by "_delete_snapshot" :: held 3.649s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" released by "delete_snapshot" :: held 3.696s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=51,cinder:UPDATE=37,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:49:53 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=47,cinder:UPDATE=41,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Created reservations ['01eb27c3-3802-455f-8e26-9de0d99ae326', 'e471da26-e8c6-44f8-9917-7465d99a0055', 'e03c95c6-8e9b-4a17-b3f1-b6134e46d697', '80b0ce98-499d-4131-92dc-7561099acc1d'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:49:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Delete snapshot completed successfully. Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-015ac6df-6424-43a0-a13f-ea9f268a0f56-delete_snapshot" released by "delete_snapshot" :: held 3.980s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-b855c8b6-3809-4c79-8fa6-664626137647-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-b855c8b6-3809-4c79-8fa6-664626137647-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-b855c8b6-3809-4c79-8fa6-664626137647" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-b855c8b6-3809-4c79-8fa6-664626137647" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Deleting offline snapshot b855c8b6-3809-4c79-8fa6-664626137647 of volume 7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] snapshot_file for this snap is: volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eeacce-b184-48c8-a771-291c0e513da3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:54 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:54 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:55 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 0.964s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:49:55 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e42621-9dff-4b88-9e50-6ee6dcfd482e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:55 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 Jul 10 05:49:55 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:56 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9" returned: 0 in 1.074s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:56 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:56 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:57 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 1.004s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:57 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647 Jul 10 05:49:57 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:57 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9.b855c8b6-3809-4c79-8fa6-664626137647" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-b855c8b6-3809-4c79-8fa6-664626137647" released by "_delete_snapshot" :: held 3.871s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" released by "delete_snapshot" :: held 3.899s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Created reservations ['419a78cc-06a0-45c7-af32-4be286c2d910', '84bf8a8b-2d32-4991-95e9-cf7f7bdcac87', '3c4eb831-6f54-414f-82e0-aa944b1e4872', 'a6a54ab9-fbea-4d24-bf9f-e78cbd48b3d7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:49:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Delete snapshot completed successfully. Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-b855c8b6-3809-4c79-8fa6-664626137647-delete_snapshot" released by "delete_snapshot" :: held 4.144s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Snapshots deleted, issuing volume delete {{(pid=87449) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c41d258-f78d-42d2-9330-478e27ad51eb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:49:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:58 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 Jul 10 05:49:58 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9" returned: 0 in 0.886s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:49:59 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:59 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9 Jul 10 05:49:59 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:49:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-c4a365c2-4b4d-47fb-856e-5bd52eb96818 tempest-ServerActionsTestOtherA-1163121724 None] Terminate volume connection completed successfully. Jul 10 05:49:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-c4a365c2-4b4d-47fb-856e-5bd52eb96818 tempest-ServerActionsTestOtherA-1163121724 None] Deleting attachment c2dd3f53-fc61-4393-bccb-5f6437068e44. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:49:59 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 10 05:49:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7f37e9b9-69d9-4028-be59-ecc85711f0d9" returned: 0 in 0.705s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:49:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-7f37e9b9-69d9-4028-be59-ecc85711f0d9" released by "delete_volume" :: held 1.649s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:49:59 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Created reservations ['227176f4-bc9a-4bb9-aaa1-b819b3c55787', '9d34c7e5-97d6-4d85-a1e6-deb83d12c3aa', 'ebba69ab-9778-472f-b22e-50c0abaeef3e', '0a2ef06e-7e41-4e35-acf2-ae02ba5d851e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:00 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:50:00 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:00 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.936s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:00 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:50:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Deleted volume successfully. Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ffa2b9b3-6564-42ed-a916-e1635518b161 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-7f37e9b9-69d9-4028-be59-ecc85711f0d9-delete_volume" released by "delete_volume" :: held 11.089s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Flow 'volume_create_manager' (7124e561-01d5-4b5f-b32e-6083a349d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea06976-237e-4ac2-a9cb-80ecfb36292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea06976-237e-4ac2-a9cb-80ecfb36292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1309760331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9248a75-b2a1-4870-b062-4be5738d6329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd4b3674ec46e2831c0ff0b56a24e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:01Z,use_quota=True,user_id='2af89f5ecc73432898c32d1836d98bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4dbed3-6ded-4799-b493-3eba69be2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4dbed3-6ded-4799-b493-3eba69be2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e368cd84-da56-45b0-b878-24802436a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e368cd84-da56-45b0-b878-24802436a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9248a75-b2a1-4870-b062-4be5738d6329', 'volume_name': 'volume-c9248a75-b2a1-4870-b062-4be5738d6329', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5891ad31-7fdf-4400-b9ac-a1b69a4c6326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5891ad31-7fdf-4400-b9ac-a1b69a4c6326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1047f7fd-0149-4835-b076-e22ff7520c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Volume c9248a75-b2a1-4870-b062-4be5738d6329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9248a75-b2a1-4870-b062-4be5738d6329', 'volume_size': 1} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1309760331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9248a75-b2a1-4870-b062-4be5738d6329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd4b3674ec46e2831c0ff0b56a24e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:01Z,use_quota=True,user_id='2af89f5ecc73432898c32d1836d98bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Creating volume c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:50:01 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:50:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:01 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 1073741824 Jul 10 05:50:01 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:02 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 1073741824" returned: 0 in 0.892s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:02 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:02 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:03 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.695s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.156s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1047f7fd-0149-4835-b076-e22ff7520c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9248a75-b2a1-4870-b062-4be5738d6329', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbffc42-66e4-4fc0-ae39-1c7452db3e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d7068-cdcd-40d4-9c7a-d84add0eaf3e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:03 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Volume volume-c9248a75-b2a1-4870-b062-4be5738d6329 (c9248a75-b2a1-4870-b062-4be5738d6329): created successfully Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbffc42-66e4-4fc0-ae39-1c7452db3e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Flow 'volume_create_manager' (7124e561-01d5-4b5f-b32e-6083a349d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-32e90a34-dd38-41b3-96ac-ab74defa64d3 tempest-VolumesDeleteCascade-1218680636 None] Created volume successfully. Jul 10 05:50:03 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 Jul 10 05:50:03 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:04 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-61964ff3-2ea5-405f-b0f2-332ee763dff7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0cfaf7b-43ca-4be9-b3b2-e834b53afcf6', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:50:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-d195b48f-afd0-40e6-94a7-0bed85ef69c6 req-2cc01f7d-4829-4add-b05c-2ea4e18bdfb8 tempest-ServerActionsTestOtherA-1163121724 None] attachment_update completed successfully. Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Creating offline snapshot 5b0a408d-e4c7-4911-8e3b-dc47ead91daa of volume c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b7d4b-0773-44d5-9844-e3b8888d7425]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:04 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:04 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:05 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.818s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:05 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa 1G Jul 10 05:50:05 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:06 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa 1G" returned: 0 in 0.788s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9248a75-b2a1-4870-b062-4be5738d6329 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:06 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9248a75-b2a1-4870-b062-4be5738d6329 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa Jul 10 05:50:06 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:07 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9248a75-b2a1-4870-b062-4be5738d6329 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:07 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa is being set with open permissions: ugo+rw Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:07 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa Jul 10 05:50:07 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Flow 'volume_create_manager' (3f0f660d-d774-4069-9092-966c1e73e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e516df7-84a5-4b1f-ab69-77f55a41ea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e516df7-84a5-4b1f-ab69-77f55a41ea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1683020682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d10d17-76f0-440b-acee-152dcc171279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef3c13b0d994258a5fef6fb15f00b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:07Z,use_quota=True,user_id='a73e8336435040d3957397432dac86dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ad7be7-0421-4def-9473-22af0497b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ad7be7-0421-4def-9473-22af0497b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4cf6ef-4354-4fb4-a697-69e801417eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4cf6ef-4354-4fb4-a697-69e801417eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d10d17-76f0-440b-acee-152dcc171279', 'volume_name': 'volume-e4d10d17-76f0-440b-acee-152dcc171279', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b114cb8-7e42-40ef-ab48-8965a6d4668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b114cb8-7e42-40ef-ab48-8965a6d4668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d519a9e8-984c-4a53-908a-081ca175b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:07 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Volume e4d10d17-76f0-440b-acee-152dcc171279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d10d17-76f0-440b-acee-152dcc171279', 'volume_size': 1} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:07 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa" returned: 0 in 0.633s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:07 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info Jul 10 05:50:07 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:08 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info" returned: 0 in 0.765s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:08 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info is being set with open permissions: ugo+rw Jul 10 05:50:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:08 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info Jul 10 05:50:08 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:09 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.info" returned: 0 in 0.671s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.526s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1683020682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d10d17-76f0-440b-acee-152dcc171279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef3c13b0d994258a5fef6fb15f00b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:07Z,use_quota=True,user_id='a73e8336435040d3957397432dac86dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Creating volume e4d10d17-76f0-440b-acee-152dcc171279 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:50:09 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:50:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:09 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 1073741824 Jul 10 05:50:09 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2f3d65ff-c897-433c-bb48-8ce4b0e0eabb tempest-VolumesDeleteCascade-1218680636 None] Create snapshot completed successfully Jul 10 05:50:10 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 1073741824" returned: 0 in 1.022s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:10 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 Jul 10 05:50:10 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Flow 'volume_create_manager' (f3f90aea-687f-441b-96f9-f9dc66cc2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01661961-a69f-4e55-8ec6-e6b73da48db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01661961-a69f-4e55-8ec6-e6b73da48db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-719257505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2fdd8b-3753-4e1b-bfe1-0846b3838221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd4b3674ec46e2831c0ff0b56a24e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b0a408d-e4c7-4911-8e3b-dc47ead91daa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:11Z,use_quota=True,user_id='2af89f5ecc73432898c32d1836d98bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c932ce23-da0d-4956-8a3e-a4d7a4b80f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c932ce23-da0d-4956-8a3e-a4d7a4b80f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160c6ada-9474-4a0f-9ff0-ebe16ed1c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160c6ada-9474-4a0f-9ff0-ebe16ed1c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a2fdd8b-3753-4e1b-bfe1-0846b3838221', 'volume_name': 'volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221', 'volume_size': 1, 'snapshot_id': '5b0a408d-e4c7-4911-8e3b-dc47ead91daa'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4527adb-423d-4867-81af-c070034b9b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4527adb-423d-4867-81af-c070034b9b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f16906d-c6dd-4df6-b578-32546efb7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:10 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Volume 1a2fdd8b-3753-4e1b-bfe1-0846b3838221: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221', 'volume_size': 1, 'snapshot_id': '5b0a408d-e4c7-4911-8e3b-dc47ead91daa'} Jul 10 05:50:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:11 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279" returned: 0 in 0.872s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.305s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-5b0a408d-e4c7-4911-8e3b-dc47ead91daa-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-5b0a408d-e4c7-4911-8e3b-dc47ead91daa-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Creating volume 1a2fdd8b-3753-4e1b-bfe1-0846b3838221 from snapshot 5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d519a9e8-984c-4a53-908a-081ca175b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d10d17-76f0-440b-acee-152dcc171279', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd2c113-7049-47b1-ab2e-db51fea6b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] snapshot: 5b0a408d-e4c7-4911-8e3b-dc47ead91daa, volume: 1a2fdd8b-3753-4e1b-bfe1-0846b3838221, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:50:11 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Volume volume-e4d10d17-76f0-440b-acee-152dcc171279 (e4d10d17-76f0-440b-acee-152dcc171279): created successfully Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd2c113-7049-47b1-ab2e-db51fea6b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Flow 'volume_create_manager' (3f0f660d-d774-4069-9092-966c1e73e463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d9f7972f-e2e2-4c64-90a2-7e20620712e3 tempest-AttachVolumeNegativeTest-1090633536 None] Created volume successfully. Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e105d55-4935-4881-ae06-18c6d3484b73]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:11 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa Jul 10 05:50:11 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:12 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9248a75-b2a1-4870-b062-4be5738d6329(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f444c578-b4fc-4cc4-966c-7465fb0d3732]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:12 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:12 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:12 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.828s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:50:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:12 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 Jul 10 05:50:12 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-33ad4a98-fe46-40c0-9eb2-07059205c6b8 req-3c4fef0e-05cb-4f76-ba1e-bd0ba528be77 tempest-AttachVolumeTestJSON-1551329018 None] Terminate volume connection completed successfully. Jul 10 05:50:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-33ad4a98-fe46-40c0-9eb2-07059205c6b8 req-3c4fef0e-05cb-4f76-ba1e-bd0ba528be77 tempest-AttachVolumeTestJSON-1551329018 None] Deleting attachment c81460b0-4e8e-4925-92ba-18260ab5022b. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:50:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:19 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" returned: 0 in 6.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[278ff74a-e569-4f63-a1ae-78dfad5e2492]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:19 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:19 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:20 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.989s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:20 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:50:20 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Converted 1024.00 MB image at 150.80 MB/s Jul 10 05:50:20 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 is being set with open permissions: ugo+rw Jul 10 05:50:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:20 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 Jul 10 05:50:20 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:21 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" returned: 0 in 0.658s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" released by "_copy_volume_from_snapshot" :: held 10.241s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-5b0a408d-e4c7-4911-8e3b-dc47ead91daa-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" released by "_create_volume_from_snapshot" :: held 10.291s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.313s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.077s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ea644-29db-4fba-911a-a4f750546f46]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f16906d-c6dd-4df6-b578-32546efb7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221', 'volume_size': 1, 'snapshot_id': '5b0a408d-e4c7-4911-8e3b-dc47ead91daa'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd6491b-41e0-4a7c-9253-8c098c01a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Volume volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 (1a2fdd8b-3753-4e1b-bfe1-0846b3838221): created successfully Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd6491b-41e0-4a7c-9253-8c098c01a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Flow 'volume_create_manager' (f3f90aea-687f-441b-96f9-f9dc66cc2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:21 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-57111897-b8c1-46b9-b3c9-5ea131001ad8 tempest-VolumesDeleteCascade-1218680636 None] Created volume successfully. Jul 10 05:50:21 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 Jul 10 05:50:21 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-c9248a75-b2a1-4870-b062-4be5738d6329-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-c9248a75-b2a1-4870-b062-4be5738d6329-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Performing cascade delete. {{(pid=87449) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-5b0a408d-e4c7-4911-8e3b-dc47ead91daa-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:22 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-5b0a408d-e4c7-4911-8e3b-dc47ead91daa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279" returned: 0 in 0.863s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-c9248a75-b2a1-4870-b062-4be5738d6329" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-c9248a75-b2a1-4870-b062-4be5738d6329" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-5b0a408d-e4c7-4911-8e3b-dc47ead91daa" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-e4d10d17-76f0-440b-acee-152dcc171279', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b8ac7a6-98fd-4415-8a89-de33fc40c190', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-5b0a408d-e4c7-4911-8e3b-dc47ead91daa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Deleting offline snapshot 5b0a408d-e4c7-4911-8e3b-dc47ead91daa of volume c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] snapshot_file for this snap is: volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb97d8a-d845-45be-9728-22a658d84022]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-3feb4587-bff8-4838-84b7-95dfa7292dec req-6a0864a9-6890-420c-9592-ddb1189815d2 tempest-AttachVolumeNegativeTest-1090633536 None] attachment_update completed successfully. Jul 10 05:50:22 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa Jul 10 05:50:22 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:23 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa" returned: 0 in 0.923s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9248a75-b2a1-4870-b062-4be5738d6329(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:50:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd497a68-c764-4a01-b4e3-62993bffecf2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:23 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:23 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:24 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:24 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa Jul 10 05:50:24 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:24 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa" returned: 0 in 0.733s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:24 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa Jul 10 05:50:24 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:25 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329.5b0a408d-e4c7-4911-8e3b-dc47ead91daa" returned: 0 in 0.640s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-5b0a408d-e4c7-4911-8e3b-dc47ead91daa" released by "_delete_snapshot" :: held 3.221s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-c9248a75-b2a1-4870-b062-4be5738d6329" released by "delete_snapshot" :: held 3.248s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Created reservations ['56a12049-d5cd-47b7-9a89-8cedc1c41143', '897f0b15-5f67-4c53-bcce-9add6910d962', '83f41d5c-d98e-423c-9e38-19af01951a5e', 'd066988d-f709-4ef9-9b76-ec5e3ad1ddba'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:50:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Delete snapshot completed successfully. Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-5b0a408d-e4c7-4911-8e3b-dc47ead91daa-delete_snapshot" released by "delete_snapshot" :: held 3.404s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Snapshots deleted, issuing volume delete {{(pid=87449) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-c9248a75-b2a1-4870-b062-4be5738d6329" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-c9248a75-b2a1-4870-b062-4be5738d6329" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e061246-d5a0-483e-82f8-91b1f3da8c06]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:25 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:25 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:26 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.906s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:26 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329 Jul 10 05:50:26 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:27 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c9248a75-b2a1-4870-b062-4be5738d6329" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-c9248a75-b2a1-4870-b062-4be5738d6329" released by "delete_volume" :: held 1.717s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Created reservations ['da114bb5-36b5-4183-8390-e27659088a30', '83ecc7f6-d91c-4b53-8a73-aa58f69ae555', '4a1f6880-aa64-45c7-9bb8-55a09389f45c', '700f4621-3574-4f9a-9de1-935526ff7568'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:27 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:50:27 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-1a2fdd8b-3753-4e1b-bfe1-0846b3838221-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-1a2fdd8b-3753-4e1b-bfe1-0846b3838221-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "cinder-quobyte-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc26f1-6582-4b29-9f8e-ba8475533d4e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:28 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 Jul 10 05:50:28 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-ca79430a-4f24-44f8-a45d-c8e16007f852 req-980c1b52-a788-4efe-a99f-6cc140fb2321 tempest-AttachVolumeNegativeTest-1090633536 None] Terminate volume connection completed successfully. Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-ca79430a-4f24-44f8-a45d-c8e16007f852 req-980c1b52-a788-4efe-a99f-6cc140fb2321 tempest-AttachVolumeNegativeTest-1090633536 None] Deleting attachment 9b8ac7a6-98fd-4415-8a89-de33fc40c190. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:50:28 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.773s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:50:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Deleted volume successfully. Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25864e16-acb0-4d05-9a7c-a132cc2956be tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-c9248a75-b2a1-4870-b062-4be5738d6329-delete_volume" released by "delete_volume" :: held 6.180s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:28 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:50:28 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:28 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" returned: 0 in 0.982s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:28 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221 Jul 10 05:50:28 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:29 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" returned: 0 in 1.054s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:29 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-quobyte-1a2fdd8b-3753-4e1b-bfe1-0846b3838221" released by "delete_volume" :: held 2.098s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.128s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Created reservations ['37651f6c-c3c9-484c-b6fe-56c697a9c261', 'b10cc673-8ad5-4c4f-860c-f25edeba7bdb', 'e9de0614-a8c8-40f4-b892-05b8e2fcf562', 'e3e355da-d997-44e4-8f9a-7bc287c718f6'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:30 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:50:30 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:31 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.356s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:31 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:50:31 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Deleted volume successfully. Jul 10 05:50:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803abf49-e951-4ffb-af1d-adda53222a3e tempest-VolumesDeleteCascade-1218680636 None] Lock "cinder-1a2fdd8b-3753-4e1b-bfe1-0846b3838221-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Flow 'volume_create_manager' (9a8c36fd-cbc9-457f-abd0-1e3c3d5cf9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d42817a-68a0-44a5-9cba-a9c7321a8915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d42817a-68a0-44a5-9cba-a9c7321a8915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1393673410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aea66b-c5cd-453f-b51f-6914049d0917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04771b31f17547a88aadcc28af59eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:35Z,use_quota=True,user_id='be683ed4d82c4b0d8333963919d4965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ece4d51-3832-41b2-9426-f51ce586b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ece4d51-3832-41b2-9426-f51ce586b068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8b4c4f-cb74-44f7-8b06-896651f01033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8b4c4f-cb74-44f7-8b06-896651f01033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8aea66b-c5cd-453f-b51f-6914049d0917', 'volume_name': 'volume-c8aea66b-c5cd-453f-b51f-6914049d0917', 'volume_size': 2}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9057510b-7ae9-4d9c-9b5c-0caedf973834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9057510b-7ae9-4d9c-9b5c-0caedf973834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06da71d8-ba96-49de-8d67-1dcc568f0890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Volume c8aea66b-c5cd-453f-b51f-6914049d0917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8aea66b-c5cd-453f-b51f-6914049d0917', 'volume_size': 2} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1393673410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aea66b-c5cd-453f-b51f-6914049d0917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04771b31f17547a88aadcc28af59eedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:35Z,use_quota=True,user_id='be683ed4d82c4b0d8333963919d4965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Creating volume c8aea66b-c5cd-453f-b51f-6914049d0917 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:50:35 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 2147483648 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:35 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 2147483648 Jul 10 05:50:35 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-d15a47b4-1589-46fa-928d-ffeecbe67c85 req-5509618b-2df9-4a5c-b766-aeb8d2c13d98 tempest-ServerActionsTestOtherA-1163121724 None] Terminate volume connection completed successfully. Jul 10 05:50:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-d15a47b4-1589-46fa-928d-ffeecbe67c85 req-5509618b-2df9-4a5c-b766-aeb8d2c13d98 tempest-ServerActionsTestOtherA-1163121724 None] Deleting attachment d0cfaf7b-43ca-4be9-b3b2-e834b53afcf6. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:50:36 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 2147483648" returned: 0 in 1.012s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:36 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 Jul 10 05:50:36 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:36 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917" returned: 0 in 0.748s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06da71d8-ba96-49de-8d67-1dcc568f0890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8aea66b-c5cd-453f-b51f-6914049d0917', 'volume_size': 2}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c5fd0c-d801-45fe-b275-57d7b98c52b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Volume volume-c8aea66b-c5cd-453f-b51f-6914049d0917 (c8aea66b-c5cd-453f-b51f-6914049d0917): created successfully Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c5fd0c-d801-45fe-b275-57d7b98c52b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Flow 'volume_create_manager' (9a8c36fd-cbc9-457f-abd0-1e3c3d5cf9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a0558ec7-42aa-4014-a59d-82bb2c59aafe tempest-VolumesCloneNegativeTest-1616904667 None] Created volume successfully. Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Acquiring lock "cinder-c8aea66b-c5cd-453f-b51f-6914049d0917-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Lock "cinder-c8aea66b-c5cd-453f-b51f-6914049d0917-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Acquiring lock "cinder-quobyte-c8aea66b-c5cd-453f-b51f-6914049d0917" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Lock "cinder-quobyte-c8aea66b-c5cd-453f-b51f-6914049d0917" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd21594-1bcb-4029-a1d3-0f154ae56e3d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:37 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 Jul 10 05:50:37 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:38 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917" returned: 0 in 0.925s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:38 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917 Jul 10 05:50:38 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:39 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c8aea66b-c5cd-453f-b51f-6914049d0917" returned: 0 in 0.778s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Lock "cinder-quobyte-c8aea66b-c5cd-453f-b51f-6914049d0917" released by "delete_volume" :: held 1.763s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Created reservations ['e5090835-8117-4828-8779-ca2303af9e59', 'f3b78906-320f-422c-9b36-fb72627a9fb1', '5a5bd718-2819-4050-af28-72e335cb386c', '8099f389-357f-4abf-8ff9-cbc7eded36d2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:39 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:50:39 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:40 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.203s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:50:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Deleted volume successfully. Jul 10 05:50:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-18d02ca6-7771-4528-adca-1092a4b24bff tempest-VolumesCloneNegativeTest-1616904667 None] Lock "cinder-c8aea66b-c5cd-453f-b51f-6914049d0917-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Flow 'volume_create_manager' (6de55c6b-2ced-49c9-8ac9-001984740b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8949f2-9c28-4df1-a8ad-1bd87926069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8949f2-9c28-4df1-a8ad-1bd87926069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1271006556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4c2161661a499ab8eb021411a40664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:44Z,use_quota=True,user_id='efacb41cf421463c8de02904434d8c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc71e4d8-72e6-46ad-ac4c-e2321c1ba9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc71e4d8-72e6-46ad-ac4c-e2321c1ba9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45385041-f855-4bd8-af3a-7f8a4b29d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45385041-f855-4bd8-af3a-7f8a4b29d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9', 'volume_name': 'volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21297a39-eace-435e-9bde-5b9fbcdf3738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21297a39-eace-435e-9bde-5b9fbcdf3738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c7bd3-66ce-44e9-b5f8-5539de9a2923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Volume a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9', 'volume_size': 1} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1271006556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4c2161661a499ab8eb021411a40664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:50:44Z,use_quota=True,user_id='efacb41cf421463c8de02904434d8c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Creating volume a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:50:44 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:50:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:44 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 1073741824 Jul 10 05:50:44 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:45 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 1073741824" returned: 0 in 0.943s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:45 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 Jul 10 05:50:45 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:46 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c7bd3-66ce-44e9-b5f8-5539de9a2923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec86b1d-0dae-4d56-8206-b5680117e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:50:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Volume volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 (a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9): created successfully Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec86b1d-0dae-4d56-8206-b5680117e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Flow 'volume_create_manager' (6de55c6b-2ced-49c9-8ac9-001984740b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:50:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2024f1e4-e277-4fcd-a808-dfeda983388f tempest-VolumesNegativeTest-764665777 None] Created volume successfully. Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "cinder-61964ff3-2ea5-405f-b0f2-332ee763dff7-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Lock "cinder-61964ff3-2ea5-405f-b0f2-332ee763dff7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "cinder-quobyte-61964ff3-2ea5-405f-b0f2-332ee763dff7" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Lock "cinder-quobyte-61964ff3-2ea5-405f-b0f2-332ee763dff7" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed27bc61-b6e1-421d-91e4-3c62e672d020]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:50:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:46 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 Jul 10 05:50:46 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:47 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7" returned: 0 in 0.805s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:47 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7 Jul 10 05:50:47 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:48 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61964ff3-2ea5-405f-b0f2-332ee763dff7" returned: 0 in 0.725s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Lock "cinder-quobyte-61964ff3-2ea5-405f-b0f2-332ee763dff7" released by "delete_volume" :: held 1.584s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Created reservations ['da100a6f-d6eb-459d-a5fe-b97fba0ea61c', 'b4587975-b701-4a16-8069-911ddda08ecd', '5711cb13-ef64-4ddc-83fa-28587e7cece1', '1e6c3ccb-ab70-4ab4-bdf1-05e0766cd5a5'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:50:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:50:48 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:50:48 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:50:49 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jul 10 05:50:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.726s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:50:49 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:50:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Deleted volume successfully. Jul 10 05:50:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ccec503-f147-4516-85f5-0a6a8f5559ee tempest-ServerActionsTestOtherA-1163121724 None] Lock "cinder-61964ff3-2ea5-405f-b0f2-332ee763dff7-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:50:54 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=63,cinder:INSERT=21,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:50:54 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=78,cinder:SELECT=72,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:51:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Acquiring lock "cinder-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:51:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Lock "cinder-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:51:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Acquiring lock "cinder-quobyte-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:51:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Lock "cinder-quobyte-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:51:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd62fb-956b-4fea-91eb-754fc115f247]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:51:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:23 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 Jul 10 05:51:23 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Flow 'volume_create_manager' (c714fd7d-83bd-4c21-93f4-9e8f6fb295bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654bf611-95b4-41c5-a726-60a8194230d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654bf611-95b4-41c5-a726-60a8194230d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1675318626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99ad41a-b541-40cb-8ed4-b8bd68e31cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef3c13b0d994258a5fef6fb15f00b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:24Z,use_quota=True,user_id='a73e8336435040d3957397432dac86dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2f9b7c-c40d-414e-ac8c-da2ea0709d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2f9b7c-c40d-414e-ac8c-da2ea0709d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:24 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1723c893-f13c-451c-9cb3-625cbbf9a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1723c893-f13c-451c-9cb3-625cbbf9a037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99ad41a-b541-40cb-8ed4-b8bd68e31cd6', 'volume_name': 'volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968ee80-0e25-4dbe-b66e-ed91538cd489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d968ee80-0e25-4dbe-b66e-ed91538cd489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eafcc12-fa9e-4a29-81d0-9b38b07f5c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Volume e99ad41a-b541-40cb-8ed4-b8bd68e31cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6', 'volume_size': 1} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1675318626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99ad41a-b541-40cb-8ed4-b8bd68e31cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef3c13b0d994258a5fef6fb15f00b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:24Z,use_quota=True,user_id='a73e8336435040d3957397432dac86dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Creating volume e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:51:24 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9" returned: 0 in 1.399s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:24 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 1073741824 Jul 10 05:51:24 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:24 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9 Jul 10 05:51:24 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:25 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9" returned: 0 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Lock "cinder-quobyte-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9" released by "delete_volume" :: held 2.301s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Created reservations ['2c7d542e-8014-4bee-8c38-339378bfeb9f', 'ccb81193-2385-4565-b113-06c53260fb0a', 'ae794628-e3ec-493d-826d-999a7d4e1dde', '4b54a270-442a-40a7-a368-d4767e992d79'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:25 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:51:25 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:25 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 1073741824" returned: 0 in 1.307s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:25 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 Jul 10 05:51:25 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:26 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.304s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:51:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Deleted volume successfully. Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a8f2acb-0caf-481b-9869-0263acbe8f5e tempest-VolumesNegativeTest-764665777 None] Lock "cinder-a5b6ac2c-f4c5-4fa5-b1d1-00a5710f1cc9-delete_volume" released by "delete_volume" :: held 4.057s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:51:27 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" returned: 0 in 1.351s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] <== create_volume: return (2725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eafcc12-fa9e-4a29-81d0-9b38b07f5c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f3d909-7be4-47fa-a851-d760041c395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:27 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Volume volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 (e99ad41a-b541-40cb-8ed4-b8bd68e31cd6): created successfully Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f3d909-7be4-47fa-a851-d760041c395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Flow 'volume_create_manager' (c714fd7d-83bd-4c21-93f4-9e8f6fb295bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9e281e66-3dda-4c70-ad93-4f4bc5991f10 tempest-AttachVolumeNegativeTest-1090633536 None] Created volume successfully. Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:28 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:51:28 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:30 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.203s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:51:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:51:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:51:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:51:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c79ab-b90c-4df1-ab63-b0e6a1f62db1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:51:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:32 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 Jul 10 05:51:32 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:33 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" returned: 0 in 1.063s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da93e8e0-dc7b-4ca7-a7ee-8f9cd9446b93', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:51:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-e73171aa-8776-408d-a61d-fbc4a4071211 req-138f9623-7d2a-45cd-8c38-dbcc40ab8d9f tempest-AttachVolumeNegativeTest-1090633536 None] attachment_update completed successfully. Jul 10 05:51:42 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-5be6ad42-5412-49ca-a60a-8e75cd2c5404 req-ed35b930-d02d-45d1-a097-53abe4f5e6f4 tempest-AttachVolumeNegativeTest-1090633536 None] Terminate volume connection completed successfully. Jul 10 05:51:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-5be6ad42-5412-49ca-a60a-8e75cd2c5404 req-ed35b930-d02d-45d1-a097-53abe4f5e6f4 tempest-AttachVolumeNegativeTest-1090633536 None] Deleting attachment da93e8e0-dc7b-4ca7-a7ee-8f9cd9446b93. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (895ba300-bbe7-401d-b4eb-d791c0e2a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63701956-7526-411b-82d7-e5deec074010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63701956-7526-411b-82d7-e5deec074010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-843062119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed39a3f5-0cf8-4186-a60a-8eb222593ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:50Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d122c02-d6ad-428b-a2c1-ed157641ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d122c02-d6ad-428b-a2c1-ed157641ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c46ed9-d187-4ec5-ac16-83194a5e03b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c46ed9-d187-4ec5-ac16-83194a5e03b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed39a3f5-0cf8-4186-a60a-8eb222593ff5', 'volume_name': 'volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7e6f6b-5a08-482d-85ca-9f9bb32f550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7e6f6b-5a08-482d-85ca-9f9bb32f550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eb470c-1e29-487c-8082-0b1806d1064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:50 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Volume ed39a3f5-0cf8-4186-a60a-8eb222593ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5', 'volume_size': 1} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-843062119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed39a3f5-0cf8-4186-a60a-8eb222593ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:50Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Creating volume ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:51:50 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:51:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:50 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 1073741824 Jul 10 05:51:50 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:51 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 1073741824" returned: 0 in 0.926s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:51 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 Jul 10 05:51:51 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:52 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" returned: 0 in 1.037s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16eb470c-1e29-487c-8082-0b1806d1064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca0d866-72a1-4bd4-808f-e92e3b22a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Volume volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 (ed39a3f5-0cf8-4186-a60a-8eb222593ff5): created successfully Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca0d866-72a1-4bd4-808f-e92e3b22a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (895ba300-bbe7-401d-b4eb-d791c0e2a5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9b09ca86-1942-4fa4-98a4-75955d3137aa tempest-VolumesSnapshotTestJSON-1300574729 None] Created volume successfully. Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Flow 'volume_create_manager' (6a640d50-da75-4cbd-8eef-21f7c91abc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c96120b-0435-46d6-ac45-81ab7f5b7c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c96120b-0435-46d6-ac45-81ab7f5b7c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-536068619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8494523-4e32-4870-b675-7c4e9c1dd6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c50db5f842428d9d2e6fc78a7c725e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:52Z,use_quota=True,user_id='3f8f5f97266444cb91edf267e67f8e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2f84f3-1665-4a56-8e00-943d735f0373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2f84f3-1665-4a56-8e00-943d735f0373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a3f14b-5928-40b7-8ed1-b5d03fff8889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a3f14b-5928-40b7-8ed1-b5d03fff8889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8494523-4e32-4870-b675-7c4e9c1dd6fe', 'volume_name': 'volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f090ee79-df60-4cd3-9c97-bba1716df25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f090ee79-df60-4cd3-9c97-bba1716df25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23880f3f-6421-4b59-a6fa-683f90e67439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Volume d8494523-4e32-4870-b675-7c4e9c1dd6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe', 'volume_size': 1} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-536068619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8494523-4e32-4870-b675-7c4e9c1dd6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c50db5f842428d9d2e6fc78a7c725e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:52Z,use_quota=True,user_id='3f8f5f97266444cb91edf267e67f8e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Creating volume d8494523-4e32-4870-b675-7c4e9c1dd6fe {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:51:52 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:51:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:52 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe 1073741824 Jul 10 05:51:52 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:53 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe 1073741824" returned: 0 in 0.873s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:53 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe Jul 10 05:51:53 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:54 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe" returned: 0 in 0.725s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.572s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Creating offline snapshot 9df73bb3-20ab-4747-912b-218d158ac4e9 of volume ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23880f3f-6421-4b59-a6fa-683f90e67439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b488ac5a-0755-4c35-a530-03aaa77b527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6f651f-a94d-479b-96d7-8c6da66f882d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:54 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Volume volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe (d8494523-4e32-4870-b675-7c4e9c1dd6fe): created successfully Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b488ac5a-0755-4c35-a530-03aaa77b527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Flow 'volume_create_manager' (6a640d50-da75-4cbd-8eef-21f7c91abc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f1773d4c-e0a2-489a-a20a-bd9938eab803 tempest-AttachVolumeTestJSON-1551329018 None] Created volume successfully. Jul 10 05:51:54 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 Jul 10 05:51:54 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "cinder-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "cinder-quobyte-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-quobyte-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:51:55 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" returned: 0 in 1.090s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bd4144-46c7-4b77-b649-ddf302e9ca6a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:51:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:55 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 1G Jul 10 05:51:55 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:55 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 Jul 10 05:51:55 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:56 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" returned: 0 in 1.052s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:56 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 1G" returned: 0 in 1.091s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:56 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6 Jul 10 05:51:56 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:56 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 Jul 10 05:51:56 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Flow 'volume_create_manager' (923cd088-3a30-40ed-b3e9-6d206fb481b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7362505f-c969-4bc3-85ed-b86098330867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7362505f-c969-4bc3-85ed-b86098330867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-99408502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ea95f3-e835-4fb9-a97a-39cb4c0e5b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff77e54c8b74b51840de40f53a8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:57Z,use_quota=True,user_id='1d464027666f4c3bb303d0a6a3f2655e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05bb8c1-5e03-47d7-bb8d-9246ee1c67cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05bb8c1-5e03-47d7-bb8d-9246ee1c67cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba52411-03cc-42c3-a60a-94148e0575c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba52411-03cc-42c3-a60a-94148e0575c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ea95f3-e835-4fb9-a97a-39cb4c0e5b34', 'volume_name': 'volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b34e9b-df71-4ccb-abd7-3cb12f068f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b34e9b-df71-4ccb-abd7-3cb12f068f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810a520d-cece-471b-ab1a-cf5772eff5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:51:57 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Volume 57ea95f3-e835-4fb9-a97a-39cb4c0e5b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34', 'volume_size': 1} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:57 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" returned: 0 in 0.921s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-quobyte-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6" released by "delete_volume" :: held 2.032s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Created reservations ['c3b2d11e-fd7d-4d4a-b32a-e3e3e71c0e8e', '35b1d602-0b79-4922-b3c6-ec21c7632757', 'd5595014-a047-4445-8c80-d6553965964a', 'f8a9fea5-26db-4336-b2e0-dc2bb6a0a9f0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:57 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:51:57 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:57 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9" returned: 0 in 1.283s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:57 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 is being set with open permissions: ugo+rw Jul 10 05:51:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:57 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 Jul 10 05:51:57 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:51:58 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.890s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:51:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Deleted volume successfully. Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6a88ce58-97ec-4ea2-8659-75e8579d8a99 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-e99ad41a-b541-40cb-8ed4-b8bd68e31cd6-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:51:58 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:58 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info Jul 10 05:51:58 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "cinder-e4d10d17-76f0-440b-acee-152dcc171279-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-e4d10d17-76f0-440b-acee-152dcc171279-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "cinder-quobyte-e4d10d17-76f0-440b-acee-152dcc171279" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-quobyte-e4d10d17-76f0-440b-acee-152dcc171279" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66d0b2-2e4c-4b0f-8010-75a9485f3195]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:51:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:59 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 Jul 10 05:51:59 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:59 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info" returned: 0 in 0.691s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:59 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info is being set with open permissions: ugo+rw Jul 10 05:51:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:59 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info Jul 10 05:51:59 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:51:59 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 10 05:51:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279" returned: 0 in 0.916s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:51:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:51:59 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279 Jul 10 05:51:59 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:00 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.info" returned: 0 in 0.866s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.051s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.281s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-99408502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ea95f3-e835-4fb9-a97a-39cb4c0e5b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff77e54c8b74b51840de40f53a8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:51:57Z,use_quota=True,user_id='1d464027666f4c3bb303d0a6a3f2655e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Creating volume 57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:00 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:00 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 1073741824 Jul 10 05:52:00 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:00 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-94500118-52ab-48d7-ae31-df960acf20c4 tempest-VolumesSnapshotTestJSON-1300574729 None] Create snapshot completed successfully Jul 10 05:52:00 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d10d17-76f0-440b-acee-152dcc171279" returned: 0 in 1.024s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-quobyte-e4d10d17-76f0-440b-acee-152dcc171279" released by "delete_volume" :: held 1.993s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:00 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Created reservations ['5e17feec-e548-4643-975e-6d66b07c782a', 'c2b95eec-a06a-44af-ada4-7f2d04aa7e8a', '16c4b26c-7bea-4747-be17-aca4a696b0f7', '69e95c3c-94c8-4a2b-a979-f7c44b02f7f0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:01 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:01 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:01 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 1073741824" returned: 0 in 1.110s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:01 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 Jul 10 05:52:01 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "cinder-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-9df73bb3-20ab-4747-912b-218d158ac4e9-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "cinder-quobyte-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-9df73bb3-20ab-4747-912b-218d158ac4e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-quobyte-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" acquired by "delete_volume" :: waited 0.073s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f974cc0-5bfa-4c49-a638-6beffb14de86]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-9df73bb3-20ab-4747-912b-218d158ac4e9" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-9df73bb3-20ab-4747-912b-218d158ac4e9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Deleting offline snapshot 9df73bb3-20ab-4747-912b-218d158ac4e9 of volume ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:52:02 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 Jul 10 05:52:02 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] snapshot_file for this snap is: volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a6199d-9446-41ad-bc82-f3be7eff2d83]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:02 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 Jul 10 05:52:02 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:02 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.490s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Deleted volume successfully. Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0627a4ac-6a57-42c3-933f-0b499433065d tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-e4d10d17-76f0-440b-acee-152dcc171279-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:02 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34" returned: 0 in 1.245s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.584s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810a520d-cece-471b-ab1a-cf5772eff5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bc0ad0-6531-4e59-8f05-d535a7cbeabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a21a2-4d61-4720-8606-f99b35add33f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:02 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Volume volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 (57ea95f3-e835-4fb9-a97a-39cb4c0e5b34): created successfully Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bc0ad0-6531-4e59-8f05-d535a7cbeabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Flow 'volume_create_manager' (923cd088-3a30-40ed-b3e9-6d206fb481b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1933b80c-22c7-40fd-b02a-b599f3b758bd tempest-ServerRescueNegativeTestJSON-1048776102 None] Created volume successfully. Jul 10 05:52:02 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe Jul 10 05:52:02 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:03 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" returned: 0 in 1.218s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:03 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804 Jul 10 05:52:03 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:03 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9" returned: 0 in 1.025s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9579640d-4734-4ec5-a06f-0d58c1ce6381]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:03 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 Jul 10 05:52:03 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:03 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" returned: 0 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-quobyte-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804" released by "delete_volume" :: held 2.137s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:03 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe" returned: 0 in 1.188s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.231s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Created reservations ['9f06341b-140d-4216-8ffb-ec9f39960782', '30bce73f-52fd-47ba-91f0-4ae7a505564f', '2cbf2ca4-3706-408e-8c35-87483169b0fa', '1067747b-6c83-4f95-889f-2e5e45cc0213'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8d33ecc-e1c2-473d-a081-5715c28f2b5d', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:52:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-fc75a3df-2694-4944-8d3e-d4e7369a403a req-96a28d4b-78db-47dc-b0c8-0a582d19cbc2 tempest-AttachVolumeTestJSON-1551329018 None] attachment_update completed successfully. Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:04 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:04 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:04 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" returned: 0 in 1.188s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:04 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 Jul 10 05:52:04 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:05 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.851s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:05 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Deleted volume successfully. Jul 10 05:52:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d144e8b6-b4d8-4916-bb33-775dbad03c69 tempest-AttachVolumeNegativeTest-1090633536 None] Lock "cinder-671ed6fa-7d6d-44cd-aa7b-0e3bc2b69804-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:05 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9" returned: 0 in 0.884s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:05 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9 Jul 10 05:52:05 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:06 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5.9df73bb3-20ab-4747-912b-218d158ac4e9" returned: 0 in 1.022s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-9df73bb3-20ab-4747-912b-218d158ac4e9" released by "_delete_snapshot" :: held 4.281s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" released by "delete_snapshot" :: held 4.328s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:06 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['bbad77ca-72c6-47ad-b92a-ca72722e2f71', '9aed21d1-613d-4424-a653-dc804837ee85', '89e16e7f-aacd-40ab-b932-4a700733ff7a', '5bf6ec45-0a0e-4ac4-bd9e-7478092c992b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Delete snapshot completed successfully. Jul 10 05:52:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-98dbf129-93a2-4f5f-9844-57d086571af6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-9df73bb3-20ab-4747-912b-218d158ac4e9-delete_snapshot" released by "delete_snapshot" :: held 4.757s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (ada297be-87f3-4e7d-a10c-59fd01ea32b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd167861-fc0e-4e33-85dc-977923125b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd167861-fc0e-4e33-85dc-977923125b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-644460426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c39ecb-198b-48dd-b5b1-a854b9fe2e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:08Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf2778b-094c-443d-a718-6ae3388f1f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf2778b-094c-443d-a718-6ae3388f1f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d87ca80-055d-4565-9382-af895b28a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d87ca80-055d-4565-9382-af895b28a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c39ecb-198b-48dd-b5b1-a854b9fe2e78', 'volume_name': 'volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afbf861-d95e-4292-817e-0ad9bb6cfa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afbf861-d95e-4292-817e-0ad9bb6cfa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecd4ac4-9c96-4d4d-9a5c-f211e6550958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:08 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Volume b3c39ecb-198b-48dd-b5b1-a854b9fe2e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78', 'volume_size': 1} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-644460426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c39ecb-198b-48dd-b5b1-a854b9fe2e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:08Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Creating volume b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:08 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:52:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:08 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 1073741824 Jul 10 05:52:08 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:09 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 1073741824" returned: 0 in 1.197s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:09 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:09 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:10 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 0.794s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecd4ac4-9c96-4d4d-9a5c-f211e6550958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed799f19-9bd3-456f-a0e6-b32ee65a92b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:10 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Volume volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 (b3c39ecb-198b-48dd-b5b1-a854b9fe2e78): created successfully Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed799f19-9bd3-456f-a0e6-b32ee65a92b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (ada297be-87f3-4e7d-a10c-59fd01ea32b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7bbbb83b-07d6-4de6-9338-ede94e1a72c1 tempest-VolumesSnapshotTestJSON-1300574729 None] Created volume successfully. Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Flow 'volume_create_manager' (f04ef059-dcbf-4605-a80f-38926ea9668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddba57c-03e3-4939-8af4-1907ca03d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddba57c-03e3-4939-8af4-1907ca03d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263256813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbb5185-2e8e-43c4-bc92-268f8cb217bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c50db5f842428d9d2e6fc78a7c725e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:11Z,use_quota=True,user_id='3f8f5f97266444cb91edf267e67f8e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e970695-5e01-4d28-88e4-cda5bb811f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e970695-5e01-4d28-88e4-cda5bb811f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fcd73d-3e94-4894-860f-027e917d2a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fcd73d-3e94-4894-860f-027e917d2a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbb5185-2e8e-43c4-bc92-268f8cb217bf', 'volume_name': 'volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d11171-0e5b-4e58-bfc5-307760e45518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d11171-0e5b-4e58-bfc5-307760e45518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032494d9-d454-4671-82a1-8b3b574a4cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:10 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Volume ffbb5185-2e8e-43c4-bc92-268f8cb217bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf', 'volume_size': 1} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263256813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbb5185-2e8e-43c4-bc92-268f8cb217bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c50db5f842428d9d2e6fc78a7c725e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:11Z,use_quota=True,user_id='3f8f5f97266444cb91edf267e67f8e57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Creating volume ffbb5185-2e8e-43c4-bc92-268f8cb217bf {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:10 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:52:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:10 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf 1073741824 Jul 10 05:52:10 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:11 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf 1073741824" returned: 0 in 0.993s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:11 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf Jul 10 05:52:11 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:12 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" returned: 0 in 0.683s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.035s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032494d9-d454-4671-82a1-8b3b574a4cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6d59fd-33ec-4094-94ac-0cbca28fe894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Creating offline snapshot 947333f1-3d93-4402-a828-956bf3eec0fc of volume b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:52:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Volume volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf (ffbb5185-2e8e-43c4-bc92-268f8cb217bf): created successfully Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6d59fd-33ec-4094-94ac-0cbca28fe894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Flow 'volume_create_manager' (f04ef059-dcbf-4605-a80f-38926ea9668f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7450568d-e725-4692-a5a2-67383d9c6653]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4c385d81-2913-4e70-b537-626a65fddf98 tempest-AttachVolumeTestJSON-1551329018 None] Created volume successfully. Jul 10 05:52:12 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:12 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:13 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:13 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc 1G Jul 10 05:52:13 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:14 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc 1G" returned: 0 in 0.913s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:14 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc Jul 10 05:52:14 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:15 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc" returned: 0 in 1.297s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:15 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc is being set with open permissions: ugo+rw Jul 10 05:52:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:15 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc Jul 10 05:52:15 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:16 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=62,cinder:UPDATE=62,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:52:16 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=60,cinder:SELECT=60,cinder:INSERT=12,cinder:DELETE=7 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:52:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:16 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc" returned: 0 in 1.281s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:16 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info Jul 10 05:52:16 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:17 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info" returned: 0 in 0.984s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:17 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info is being set with open permissions: ugo+rw Jul 10 05:52:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:17 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info Jul 10 05:52:17 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-978e3afb-056d-4f3b-ae86-d27809a37978 tempest-GroupSnapshotsTest-468388524 None] Group tempest-GroupSnapshotsTest-Group-1367302556: creating Jul 10 05:52:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-978e3afb-056d-4f3b-ae86-d27809a37978 tempest-GroupSnapshotsTest-468388524 None] Group tempest-GroupSnapshotsTest-Group-1367302556: created successfully Jul 10 05:52:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-978e3afb-056d-4f3b-ae86-d27809a37978 tempest-GroupSnapshotsTest-468388524 None] Create group completed successfully. Jul 10 05:52:18 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.info" returned: 0 in 0.722s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.208s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.306s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f6c62-a085-440c-ad42-8dc31e7d827e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d886c45a-5b73-418b-82c9-8c64878affe4 tempest-VolumesSnapshotTestJSON-1300574729 None] Create snapshot completed successfully Jul 10 05:52:18 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf Jul 10 05:52:18 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (bb4e2d89-d459-4e55-ac80-52fc7d787b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456c081-40e3-4601-878e-fa586402e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456c081-40e3-4601-878e-fa586402e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-727322414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3be167-46ed-4628-ae31-ba70127fed6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=947333f1-3d93-4402-a828-956bf3eec0fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:19Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c7da1c-048c-4a16-a7b3-d3770272508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c7da1c-048c-4a16-a7b3-d3770272508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d082b3d5-e929-4855-b29d-654082bd8b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d082b3d5-e929-4855-b29d-654082bd8b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be3be167-46ed-4628-ae31-ba70127fed6d', 'volume_name': 'volume-be3be167-46ed-4628-ae31-ba70127fed6d', 'volume_size': 2, 'snapshot_id': '947333f1-3d93-4402-a828-956bf3eec0fc'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ba42bc-390c-40e6-a509-c89265259d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ba42bc-390c-40e6-a509-c89265259d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4dbda1-687b-41fe-994e-b684c7f3d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Volume be3be167-46ed-4628-ae31-ba70127fed6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be3be167-46ed-4628-ae31-ba70127fed6d', 'volume_size': 2, 'snapshot_id': '947333f1-3d93-4402-a828-956bf3eec0fc'} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:19 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" returned: 0 in 0.847s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.028s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-947333f1-3d93-4402-a828-956bf3eec0fc-be3be167-46ed-4628-ae31-ba70127fed6d" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-947333f1-3d93-4402-a828-956bf3eec0fc-be3be167-46ed-4628-ae31-ba70127fed6d" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Creating volume be3be167-46ed-4628-ae31-ba70127fed6d from snapshot 947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-be3be167-46ed-4628-ae31-ba70127fed6d" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8831340f-fe83-45c3-9bb5-3041c7d2b425', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-be3be167-46ed-4628-ae31-ba70127fed6d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] snapshot: 947333f1-3d93-4402-a828-956bf3eec0fc, volume: be3be167-46ed-4628-ae31-ba70127fed6d, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16f570-4660-4640-bec6-78942ad0d489]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-b91b49d1-d24d-4593-b7d5-db1c984e07b5 req-9cd249ca-7dff-4c89-870a-a4f7ca187ac1 tempest-AttachVolumeTestJSON-1551329018 None] attachment_update completed successfully. Jul 10 05:52:19 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc Jul 10 05:52:19 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (2442b98e-d0ca-4b65-bde7-4a9b27ebe705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9e0683-e169-41b8-9f51-eb3ae3dda8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9e0683-e169-41b8-9f51-eb3ae3dda8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2140488950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b589e608-2ace-4b24-861a-cf37e25359cf,host='devstack@QuobyteHD#QuobyteHD',id=592e7c9f-7763-4dcb-a17d-287e69a132ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:20Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21fad4a6-ba96-41d9-a10d-5ec82822c791),volume_type_id=21fad4a6-ba96-41d9-a10d-5ec82822c791)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f4d472-4461-4cc2-bdaf-c1f5bf4414e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f4d472-4461-4cc2-bdaf-c1f5bf4414e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdeaca3-f225-41e5-9389-99b7e6b091e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdeaca3-f225-41e5-9389-99b7e6b091e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592e7c9f-7763-4dcb-a17d-287e69a132ff', 'volume_name': 'volume-592e7c9f-7763-4dcb-a17d-287e69a132ff', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd0990f-c4e7-41fc-95ac-45725fa2b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd0990f-c4e7-41fc-95ac-45725fa2b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ffdb31-449e-4540-89b9-2945a9a9316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Volume 592e7c9f-7763-4dcb-a17d-287e69a132ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592e7c9f-7763-4dcb-a17d-287e69a132ff', 'volume_size': 1} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:20 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc" returned: 0 in 1.180s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[10816d57-a8e3-45ac-9011-5fc5eafd3911]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:20 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:20 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:21 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 0.839s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:21 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d Jul 10 05:52:21 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Acquiring lock "cinder-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "cinder-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Acquiring lock "cinder-quobyte-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "cinder-quobyte-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[51701bb1-383c-458f-8daf-9ac79dd4dc18]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:21 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 Jul 10 05:52:21 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:23 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34" returned: 0 in 1.247s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:23 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34 Jul 10 05:52:23 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:24 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34" returned: 0 in 1.675s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "cinder-quobyte-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34" released by "delete_volume" :: held 3.025s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:24 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Created reservations ['439762b1-ec2c-452e-8f4f-57d508154d5d', '74704e6f-c617-411f-84e3-7f7122aad04a', 'ab218812-2fb5-4afb-b156-bb013115ca87', '5c7afe36-6338-4c5a-bfb4-255e9fe98866'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:25 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:25 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:27 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 2.033s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:27 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Deleted volume successfully. Jul 10 05:52:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d7aebcd9-2a21-4ed8-b451-24c3aaba6c35 tempest-ServerRescueNegativeTestJSON-1048776102 None] Lock "cinder-57ea95f3-e835-4fb9-a97a-39cb4c0e5b34-delete_volume" released by "delete_volume" :: held 5.603s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-1ef4852f-5f2f-4bcf-af89-51c608851fec req-25e120d6-1bf1-426f-86bc-96349e833c12 tempest-AttachVolumeTestJSON-1551329018 None] Terminate volume connection completed successfully. Jul 10 05:52:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-1ef4852f-5f2f-4bcf-af89-51c608851fec req-25e120d6-1bf1-426f-86bc-96349e833c12 tempest-AttachVolumeTestJSON-1551329018 None] Deleting attachment a8d33ecc-e1c2-473d-a081-5715c28f2b5d. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:52:29 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:29 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:30 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d" returned: 0 in 8.410s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade5433-9a60-4a86-aa67-7ab16de7799f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:30 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:30 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:30 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.548s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:52:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:52:31 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 1.373s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:31 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:52:31 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Converted 1024.00 MB image at 121.74 MB/s Jul 10 05:52:31 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d is being set with open permissions: ugo+rw Jul 10 05:52:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:31 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d Jul 10 05:52:31 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:31 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-6051873d-8982-4cba-ab55-c86c328f342f req-ad270ab3-14f4-4ae8-bdbc-453c52d3d54f tempest-AttachVolumeTestJSON-1551329018 None] Terminate volume connection completed successfully. Jul 10 05:52:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-6051873d-8982-4cba-ab55-c86c328f342f req-ad270ab3-14f4-4ae8-bdbc-453c52d3d54f tempest-AttachVolumeTestJSON-1551329018 None] Deleting attachment 8831340f-fe83-45c3-9bb5-3041c7d2b425. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:52:32 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d" returned: 0 in 0.707s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-be3be167-46ed-4628-ae31-ba70127fed6d" released by "_copy_volume_from_snapshot" :: held 12.649s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-947333f1-3d93-4402-a828-956bf3eec0fc-be3be167-46ed-4628-ae31-ba70127fed6d" released by "_create_volume_from_snapshot" :: held 12.700s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.728s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.816s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b589e608-2ace-4b24-861a-cf37e25359cf,created_at=2026-07-10T03:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2140488950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b589e608-2ace-4b24-861a-cf37e25359cf,host='devstack@QuobyteHD#QuobyteHD',id=592e7c9f-7763-4dcb-a17d-287e69a132ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:20Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21fad4a6-ba96-41d9-a10d-5ec82822c791),volume_type_id=21fad4a6-ba96-41d9-a10d-5ec82822c791)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Creating volume 592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:32 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:32 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff 1073741824 Jul 10 05:52:32 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4dbda1-687b-41fe-994e-b684c7f3d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3be167-46ed-4628-ae31-ba70127fed6d', 'volume_size': 2, 'snapshot_id': '947333f1-3d93-4402-a828-956bf3eec0fc'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6139c2c-b16c-44fd-ab76-ed5d5d2f67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:32 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Volume volume-be3be167-46ed-4628-ae31-ba70127fed6d (be3be167-46ed-4628-ae31-ba70127fed6d): created successfully Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6139c2c-b16c-44fd-ab76-ed5d5d2f67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (bb4e2d89-d459-4e55-ac80-52fc7d787b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c1e861fc-b2f2-4973-8aeb-53f18a8aed9a tempest-VolumesSnapshotTestJSON-1300574729 None] Created volume successfully. Jul 10 05:52:33 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff 1073741824" returned: 0 in 0.892s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:33 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:52:33 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-be3be167-46ed-4628-ae31-ba70127fed6d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-be3be167-46ed-4628-ae31-ba70127fed6d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-be3be167-46ed-4628-ae31-ba70127fed6d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-be3be167-46ed-4628-ae31-ba70127fed6d" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69c1b03-fc7a-454d-a233-b93863513fea]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:33 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d Jul 10 05:52:33 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:33 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ffdb31-449e-4540-89b9-2945a9a9316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592e7c9f-7763-4dcb-a17d-287e69a132ff', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd203af7-3a77-4f2b-976b-e33b54b7231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:33 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Volume volume-592e7c9f-7763-4dcb-a17d-287e69a132ff (592e7c9f-7763-4dcb-a17d-287e69a132ff): created successfully Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd203af7-3a77-4f2b-976b-e33b54b7231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (2442b98e-d0ca-4b65-bde7-4a9b27ebe705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-50587afa-002f-42a0-84a5-e7e6b48b3841 tempest-GroupSnapshotsTest-468388524 None] Created volume successfully. Jul 10 05:52:34 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d" returned: 0 in 0.838s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:34 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d Jul 10 05:52:34 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] GroupSnapshot fdb55710-3da4-498c-9672-166389e1b1f3: creating. Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Group snapshot fdb55710-3da4-498c-9672-166389e1b1f3: creating. {{(pid=87449) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Creating offline snapshot b75d3651-eeac-47a7-8e42-fc31680f655a of volume 592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66938e-fea0-4b46-9fb1-1d0261d50d4c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:35 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:52:35 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:35 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be3be167-46ed-4628-ae31-ba70127fed6d" returned: 0 in 0.810s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-be3be167-46ed-4628-ae31-ba70127fed6d" released by "delete_volume" :: held 1.689s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['7545346a-9f85-4dca-aabc-c627c7e2937e', '44d715bf-99d5-45e2-bb51-d8835f6b7ff5', 'a896398f-dbd3-4fcf-9cd9-f87a05c2259d', '0d580c36-d891-4a81-9ec2-4fb520ee6845'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:35 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:35 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:35 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:35 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a 1G Jul 10 05:52:35 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-947333f1-3d93-4402-a828-956bf3eec0fc-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-947333f1-3d93-4402-a828-956bf3eec0fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-947333f1-3d93-4402-a828-956bf3eec0fc" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-947333f1-3d93-4402-a828-956bf3eec0fc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Deleting offline snapshot 947333f1-3d93-4402-a828-956bf3eec0fc of volume b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] snapshot_file for this snap is: volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4025b6e-b3a5-4075-90ff-db9c49b3131d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:36 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc Jul 10 05:52:36 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:36 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.024s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:36 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Deleted volume successfully. Jul 10 05:52:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386778f1-63ac-4c47-a114-f7be79095f35 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-be3be167-46ed-4628-ae31-ba70127fed6d-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:37 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a 1G" returned: 0 in 1.438s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592e7c9f-7763-4dcb-a17d-287e69a132ff -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:37 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592e7c9f-7763-4dcb-a17d-287e69a132ff -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a Jul 10 05:52:37 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:37 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc" returned: 0 in 1.466s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:52:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c0dff-b442-4efc-bb67-472974526ff5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:37 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:37 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:38 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592e7c9f-7763-4dcb-a17d-287e69a132ff -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a" returned: 0 in 0.864s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:38 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:52:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:38 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a Jul 10 05:52:38 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:38 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 1.025s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:38 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc Jul 10 05:52:38 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:38 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a" returned: 0 in 0.764s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:39 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info Jul 10 05:52:39 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:39 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc" returned: 0 in 0.819s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:39 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc Jul 10 05:52:39 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:39 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:39 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:52:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:39 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info Jul 10 05:52:39 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:40 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78.947333f1-3d93-4402-a828-956bf3eec0fc" returned: 0 in 0.677s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-947333f1-3d93-4402-a828-956bf3eec0fc" released by "_delete_snapshot" :: held 4.180s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" released by "delete_snapshot" :: held 4.209s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['f9ad5246-1959-4eac-a807-231889e4bfae', 'bb2b8034-66ec-4dcb-8601-fe03d053f7ad', 'ce16243d-9a2f-4b6a-a148-d71ad0ace69c', '72de3567-b959-4448-ba70-7cc867d34de3'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Delete snapshot completed successfully. Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ff31a4ea-2a70-4a02-bb6c-b7b7ba02226f tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-947333f1-3d93-4402-a828-956bf3eec0fc-delete_snapshot" released by "delete_snapshot" :: held 4.350s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:40 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.info" returned: 0 in 0.672s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.339s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-61062ba7-a57f-4344-850b-1df666f210c5 tempest-GroupSnapshotsTest-468388524 None] group_snapshot fdb55710-3da4-498c-9672-166389e1b1f3: created successfully Jul 10 05:52:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:41 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a30b2-0668-4698-ac95-053eb99de649]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:41 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:41 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:42 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 0.834s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:42 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78 Jul 10 05:52:42 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-b75d3651-eeac-47a7-8e42-fc31680f655a-f9987e4c-18fa-41cb-a502-93103598de05" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-b75d3651-eeac-47a7-8e42-fc31680f655a-f9987e4c-18fa-41cb-a502-93103598de05" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Creating volume f9987e4c-18fa-41cb-a502-93103598de05 from snapshot b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-f9987e4c-18fa-41cb-a502-93103598de05" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-f9987e4c-18fa-41cb-a502-93103598de05" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] snapshot: b75d3651-eeac-47a7-8e42-fc31680f655a, volume: f9987e4c-18fa-41cb-a502-93103598de05, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fe4c8-abe2-438c-9f10-dfc8b5bc4df1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:43 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" returned: 0 in 0.720s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78" released by "delete_volume" :: held 1.636s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['158c2115-01a2-4c1f-aa67-c29c8b4e8601', '07e20916-2e86-4801-bf04-61429c8c38cf', '5e946f8c-8262-4bad-ae2c-b8cc83366717', 'ee2e1d42-2eda-4787-969d-0ccd3d1612a0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:43 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a Jul 10 05:52:43 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:43 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:43 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:44 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:44 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.881s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a" returned: 0 in 1.150s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-592e7c9f-7763-4dcb-a17d-287e69a132ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:52:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Deleted volume successfully. Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ffcff-8c2a-46d5-8b04-a659c4f6e042]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0bcb27cf-0d94-4d41-b01e-8d5c664bdfc8 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-b3c39ecb-198b-48dd-b5b1-a854b9fe2e78-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:44 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:52:44 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (9842c2dd-3f8c-409d-9216-1eee7df2d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7230d77e-4f93-4ca2-a832-7e0d60113fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "cinder-ffbb5185-2e8e-43c4-bc92-268f8cb217bf-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7230d77e-4f93-4ca2-a832-7e0d60113fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1148539248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e1144-4b39-48f0-b48c-a8a74b4928a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:44Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840aa31f-eb5e-4786-9b48-d3c90a5818fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840aa31f-eb5e-4786-9b48-d3c90a5818fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0535a7f-e7c6-4510-adbc-ded103056e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0535a7f-e7c6-4510-adbc-ded103056e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6e1144-4b39-48f0-b48c-a8a74b4928a7', 'volume_name': 'volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90029d51-64c9-4e5f-874a-a1e41aa2644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90029d51-64c9-4e5f-874a-a1e41aa2644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea4fbf5-6d5d-4017-a684-b69357c97878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Volume 0f6e1144-4b39-48f0-b48c-a8a74b4928a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7', 'volume_size': 1} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-ffbb5185-2e8e-43c4-bc92-268f8cb217bf-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "cinder-quobyte-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-quobyte-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37359fc-c9c8-45e7-bde8-2b212add4918]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:44 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf Jul 10 05:52:44 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:45 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 1.137s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:45 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:52:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:45 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 Jul 10 05:52:45 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:45 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" returned: 0 in 0.866s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:45 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf Jul 10 05:52:45 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:46 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" returned: 0 in 0.800s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-quobyte-ffbb5185-2e8e-43c4-bc92-268f8cb217bf" released by "delete_volume" :: held 1.751s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Created reservations ['45e485a1-60f8-41e4-a553-cb1554330f89', '2c2867ba-c378-494b-9228-513715e2ae21', 'c0bb2ad9-26d6-4ece-8ac3-e88dd221edd5', '148cade2-f2a2-4554-ab3e-35bd917a6d4a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:46 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:46 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "cinder-d8494523-4e32-4870-b675-7c4e9c1dd6fe-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-d8494523-4e32-4870-b675-7c4e9c1dd6fe-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "cinder-quobyte-d8494523-4e32-4870-b675-7c4e9c1dd6fe" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-quobyte-d8494523-4e32-4870-b675-7c4e9c1dd6fe" acquired by "delete_volume" :: waited 0.045s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[761c8c75-f8a1-419b-96b4-b13fe3070572]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:47 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe Jul 10 05:52:47 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:48 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 2.003s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:48 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Deleted volume successfully. Jul 10 05:52:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-479f01b0-bf5d-4044-ab9f-4e8080debaec tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-ffbb5185-2e8e-43c4-bc92-268f8cb217bf-delete_volume" released by "delete_volume" :: held 4.289s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:48 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe" returned: 0 in 1.521s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:48 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe Jul 10 05:52:48 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:50 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d8494523-4e32-4870-b675-7c4e9c1dd6fe" returned: 0 in 1.522s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-quobyte-d8494523-4e32-4870-b675-7c4e9c1dd6fe" released by "delete_volume" :: held 3.159s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Created reservations ['3c15c097-3d18-4c3c-b5af-33183ebd2bb7', '442af605-5672-42b4-8884-76b0f64e1344', 'fe52d0ad-584a-4a5d-9f31-f57861442ec6', '96649c90-ac5b-476e-ae90-1762812ac939'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:50 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:50 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "cinder-72547676-66fc-4e30-84a8-2c2786daa02f-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-72547676-66fc-4e30-84a8-2c2786daa02f-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "cinder-quobyte-72547676-66fc-4e30-84a8-2c2786daa02f" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-quobyte-72547676-66fc-4e30-84a8-2c2786daa02f" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f29c30-2a93-40f4-b2b0-ffb3485c7ef2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:51 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05" returned: 0 in 6.349s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[998a0671-ba32-494f-8396-25af73805e9a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:51 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f Jul 10 05:52:51 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:51 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:52:51 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:51 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.009s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Deleted volume successfully. Jul 10 05:52:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9e851833-3dc0-43c6-95cd-079a83662333 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-d8494523-4e32-4870-b675-7c4e9c1dd6fe-delete_volume" released by "delete_volume" :: held 4.777s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:52 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f" returned: 0 in 0.950s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:52 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f Jul 10 05:52:52 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:52 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 1.160s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:52 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:52:52 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Converted 1024.00 MB image at 161.26 MB/s Jul 10 05:52:52 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:52:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:52 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 Jul 10 05:52:52 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:53 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-72547676-66fc-4e30-84a8-2c2786daa02f" returned: 0 in 0.799s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-quobyte-72547676-66fc-4e30-84a8-2c2786daa02f" released by "delete_volume" :: held 1.814s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Created reservations ['c45d9e80-9c3d-4462-a61c-f4415f68fec1', 'c421999f-1fef-4aeb-9a76-24d57df0901b', '66104398-caeb-496e-ab1b-f59607aeb45d', 'c5c556a4-ad75-49c8-ba48-2dc89e1a25b1'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:53 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:53 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:53 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05" returned: 0 in 0.732s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-f9987e4c-18fa-41cb-a502-93103598de05" released by "_copy_volume_from_snapshot" :: held 10.647s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-b75d3651-eeac-47a7-8e42-fc31680f655a-f9987e4c-18fa-41cb-a502-93103598de05" released by "_create_volume_from_snapshot" :: held 10.682s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.700s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.998s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1148539248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e1144-4b39-48f0-b48c-a8a74b4928a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:52:44Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Creating volume 0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:52:53 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:52:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:53 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 1073741824 Jul 10 05:52:53 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e5730449-3fe8-4a4d-80a3-8fd59142bfea tempest-GroupSnapshotsTest-468388524 None] Create group from source-snapshot-fdb55710-3da4-498c-9672-166389e1b1f3 completed successfully. Jul 10 05:52:54 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.899s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Deleted volume successfully. Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ba2d26e9-cd01-495b-9def-ca6c848bc450 tempest-AttachVolumeTestJSON-1551329018 None] Lock "cinder-72547676-66fc-4e30-84a8-2c2786daa02f-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:54 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-f9987e4c-18fa-41cb-a502-93103598de05" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 1073741824" returned: 0 in 1.209s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-f9987e4c-18fa-41cb-a502-93103598de05" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850e46e-313e-4d22-9211-d4761bcc3b6d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:54 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:52:54 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:55 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 Jul 10 05:52:55 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:55 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 0.738s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea4fbf5-6d5d-4017-a684-b69357c97878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02feba88-dc72-4242-9d4a-03c3f59a533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:52:55 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Volume volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 (0f6e1144-4b39-48f0-b48c-a8a74b4928a7): created successfully Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02feba88-dc72-4242-9d4a-03c3f59a533b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (9842c2dd-3f8c-409d-9216-1eee7df2d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:52:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-53d4b952-7a9c-4857-a03a-2b415369bf3e tempest-VolumesSnapshotTestJSON-1300574729 None] Created volume successfully. Jul 10 05:52:55 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05" returned: 0 in 0.987s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:55 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05 Jul 10 05:52:55 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:56 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f9987e4c-18fa-41cb-a502-93103598de05" returned: 0 in 0.678s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-f9987e4c-18fa-41cb-a502-93103598de05" released by "delete_volume" :: held 1.732s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['d7d7d4ce-0f08-431f-8e35-986cae0e26db'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:56 devstack cinder-volume[87449]: WARNING cinder.quota [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1207247277 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1207247277, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:52:56 devstack cinder-volume[87449]: WARNING cinder.quota [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1207247277 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1207247277, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['451c05a9-6ca5-449a-b0d5-454884ec835f', '583f8d0c-2bb1-4433-afcd-2468a6d38189', '8d1ec49b-4f22-481f-a92b-3ef38797d301', 'd7dad90e-47f6-47b0-a790-3c682b14af2a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:52:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:56 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:52:56 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Creating offline snapshot 27478657-0dc0-4ba3-a6b1-80c03163191e of volume 0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d22baee-e72f-45d8-be48-4ecec4456a57]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:57 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:52:57 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] group_snapshot fdb55710-3da4-498c-9672-166389e1b1f3: deleting Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] group_snapshot fdb55710-3da4-498c-9672-166389e1b1f3: deleting {{(pid=87449) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-592e7c9f-7763-4dcb-a17d-287e69a132ff" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-592e7c9f-7763-4dcb-a17d-287e69a132ff" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-b75d3651-eeac-47a7-8e42-fc31680f655a" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-b75d3651-eeac-47a7-8e42-fc31680f655a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Deleting offline snapshot b75d3651-eeac-47a7-8e42-fc31680f655a of volume 592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] snapshot_file for this snap is: volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef12389-0897-467d-9718-d3dcc6adb5da]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:58 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a Jul 10 05:52:58 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:58 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.384s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:58 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:52:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ced8dba9-17ee-4736-9887-76f9ba0059f6 tempest-GroupSnapshotsTest-468388524 None] Delete group completed successfully. Jul 10 05:52:58 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 1.390s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:58 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e 1G Jul 10 05:52:58 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:58 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a" returned: 0 in 1.095s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-592e7c9f-7763-4dcb-a17d-287e69a132ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:52:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fb9dcf-3843-451d-8f84-1945084a1d3c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:52:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:59 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:52:59 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:52:59 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 10 05:52:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e 1G" returned: 0 in 1.353s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:52:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:52:59 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e Jul 10 05:52:59 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:00 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 1.037s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:00 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a Jul 10 05:53:00 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:00 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e" returned: 0 in 0.964s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:00 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e is being set with open permissions: ugo+rw Jul 10 05:53:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:00 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e Jul 10 05:53:00 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:01 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a" returned: 0 in 1.150s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:01 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a Jul 10 05:53:01 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:01 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e" returned: 0 in 0.722s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:01 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info Jul 10 05:53:01 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:02 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff.b75d3651-eeac-47a7-8e42-fc31680f655a" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-b75d3651-eeac-47a7-8e42-fc31680f655a" released by "_delete_snapshot" :: held 4.302s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-592e7c9f-7763-4dcb-a17d-287e69a132ff" released by "delete_snapshot" :: held 4.349s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:02 devstack cinder-volume[87449]: WARNING cinder.quota [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1207247277 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1207247277, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['04edb883-422e-40a2-bca2-53494325f3b0', '16aa76e6-b9eb-4854-a4c7-9674a0909ada', 'a3dd768d-a6e3-4bd5-a534-bc6d52e1b232', '9cd6bc7c-c6ec-4d80-91e1-923d8c7661bc'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b45426ed-087d-4f96-a70c-ccf87020eb41 tempest-GroupSnapshotsTest-468388524 None] group_snapshot fdb55710-3da4-498c-9672-166389e1b1f3: deleted successfully Jul 10 05:53:02 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info" returned: 0 in 0.823s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:02 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info is being set with open permissions: ugo+rw Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:02 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info Jul 10 05:53:02 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-592e7c9f-7763-4dcb-a17d-287e69a132ff" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-592e7c9f-7763-4dcb-a17d-287e69a132ff" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c9e976-4fbd-4578-b6a3-17de7c6115c1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:02 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:53:02 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:03 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.info" returned: 0 in 0.869s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.268s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Flow 'volume_create_manager' (f74ec053-935d-409a-9b5d-aa8235587ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8190268-23b7-4bbe-b0f1-37622130510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6bdd1e3f-9c59-4d0d-b100-e3ddea994b92 tempest-VolumesSnapshotTestJSON-1300574729 None] Create snapshot completed successfully Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8190268-23b7-4bbe-b0f1-37622130510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1402259398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc40ca5a-f34b-4fee-933e-b1dc10323cf7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8240568fb13e40ab9da4a9b8fccf5f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:03Z,use_quota=True,user_id='35c906f9950b47b2a3bde107ae95295b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a4224f-ec69-4c79-8d90-9ff80bbe0f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a4224f-ec69-4c79-8d90-9ff80bbe0f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aade998c-9992-4649-8224-d74020d5d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aade998c-9992-4649-8224-d74020d5d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc40ca5a-f34b-4fee-933e-b1dc10323cf7', 'volume_name': 'volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73e234c-3805-425f-a5e6-4f6b5770b5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73e234c-3805-425f-a5e6-4f6b5770b5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88b3cd3-2493-4e8a-8f3e-3bb1d16f30cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:03 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Volume fc40ca5a-f34b-4fee-933e-b1dc10323cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7', 'volume_size': 1} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1402259398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc40ca5a-f34b-4fee-933e-b1dc10323cf7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8240568fb13e40ab9da4a9b8fccf5f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:03Z,use_quota=True,user_id='35c906f9950b47b2a3bde107ae95295b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Creating volume fc40ca5a-f34b-4fee-933e-b1dc10323cf7 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:03 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:03 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 1073741824 Jul 10 05:53:03 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:03 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 0.984s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:03 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff Jul 10 05:53:03 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:04 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 1073741824" returned: 0 in 0.891s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:04 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 Jul 10 05:53:04 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:04 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-592e7c9f-7763-4dcb-a17d-287e69a132ff" returned: 0 in 0.705s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-592e7c9f-7763-4dcb-a17d-287e69a132ff" released by "delete_volume" :: held 1.805s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['355c216e-e8c1-4cb9-9281-f771ef04e8cb'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:04 devstack cinder-volume[87449]: WARNING cinder.db.api [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1207247277'] Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['6ef4d25f-5897-433d-b15b-d08a533acaf7', '0dc123fd-c2f4-4646-8d2c-0b511b0483dc', 'c47594b5-d172-44b5-9e76-8c2faad377cd', '4cac8367-1084-4789-a322-a3a2233bbaa3'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:04 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:04 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (db334da7-8115-41fe-80f1-0769804aa3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfeb7fa-a1a3-49f2-9fe3-513215061d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfeb7fa-a1a3-49f2-9fe3-513215061d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1832793215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec3ef1e-156d-4a06-ab16-ed644a1a1a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c8652f38ec44bcb94d00c22752199a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27478657-0dc0-4ba3-a6b1-80c03163191e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:05Z,use_quota=True,user_id='f3349b00a91248beae26345b1bccb2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a72a481-fff2-4efc-969c-9ff6a02ce6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a72a481-fff2-4efc-969c-9ff6a02ce6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e939c2-728d-4fb6-9315-bd4a611630a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e939c2-728d-4fb6-9315-bd4a611630a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aec3ef1e-156d-4a06-ab16-ed644a1a1a40', 'volume_name': 'volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40', 'volume_size': 1, 'snapshot_id': '27478657-0dc0-4ba3-a6b1-80c03163191e'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f384fde-34e7-4fad-b705-5a88620c94b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f384fde-34e7-4fad-b705-5a88620c94b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e26f2f-f7f4-47ca-8870-965f0a5ed563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Volume aec3ef1e-156d-4a06-ab16-ed644a1a1a40: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40', 'volume_size': 1, 'snapshot_id': '27478657-0dc0-4ba3-a6b1-80c03163191e'} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:05 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7" returned: 0 in 1.015s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.078s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-27478657-0dc0-4ba3-a6b1-80c03163191e-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88b3cd3-2493-4e8a-8f3e-3bb1d16f30cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf868ede-da1b-47e4-bea9-b07073859ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-27478657-0dc0-4ba3-a6b1-80c03163191e-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Creating volume aec3ef1e-156d-4a06-ab16-ed644a1a1a40 from snapshot 27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Volume volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 (fc40ca5a-f34b-4fee-933e-b1dc10323cf7): created successfully Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf868ede-da1b-47e4-bea9-b07073859ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Flow 'volume_create_manager' (f74ec053-935d-409a-9b5d-aa8235587ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] snapshot: 27478657-0dc0-4ba3-a6b1-80c03163191e, volume: aec3ef1e-156d-4a06-ab16-ed644a1a1a40, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-05f2c9bc-c160-4e9d-a171-0db06486bb87 req-820d2cc5-3804-4f50-8f66-cc359a528a00 tempest-VolumesGetTestJSON-1568779631 None] Created volume successfully. Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[78306cff-08c4-422a-bc9f-0176b24033f4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:05 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e Jul 10 05:53:05 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:06 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.192s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-831b565c-c91b-4b90-8a8d-455211bd2774 tempest-GroupSnapshotsTest-468388524 None] Delete group completed successfully. Jul 10 05:53:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0df92d7b-ac23-4b81-b807-c2aba6020698 tempest-GroupSnapshotsTest-468388524 None] Group tempest-GroupSnapshotsTest-Group-439452572: creating Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Acquiring lock "cinder-fc40ca5a-f34b-4fee-933e-b1dc10323cf7-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0df92d7b-ac23-4b81-b807-c2aba6020698 tempest-GroupSnapshotsTest-468388524 None] Group tempest-GroupSnapshotsTest-Group-439452572: created successfully Jul 10 05:53:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0df92d7b-ac23-4b81-b807-c2aba6020698 tempest-GroupSnapshotsTest-468388524 None] Create group completed successfully. Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Lock "cinder-fc40ca5a-f34b-4fee-933e-b1dc10323cf7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Acquiring lock "cinder-quobyte-fc40ca5a-f34b-4fee-933e-b1dc10323cf7" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Lock "cinder-quobyte-fc40ca5a-f34b-4fee-933e-b1dc10323cf7" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c264cd36-500f-4f43-9ba0-2e2b9b2ed4a2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:06 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 Jul 10 05:53:06 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:06 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e" returned: 0 in 1.231s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd38eab9-93ee-4f75-a0b1-99d0894693b6]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:07 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:53:07 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:07 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7" returned: 0 in 0.866s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:07 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7 Jul 10 05:53:07 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:07 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 1.052s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:08 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 Jul 10 05:53:08 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (afa4b3c9-0834-4a11-872e-90ef0badac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede608d2-f538-4b8c-8fe8-dc1d5d749c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede608d2-f538-4b8c-8fe8-dc1d5d749c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424801225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0753a3-7302-4f79-a9ea-8174d27c0ef8,host='devstack@QuobyteHD#QuobyteHD',id=2136629f-b1c0-4269-a97d-9381c86a92ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:08Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23b3f57a-715d-4cf4-a24d-a751b221abdb),volume_type_id=23b3f57a-715d-4cf4-a24d-a751b221abdb)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d043b-7aef-426d-ba23-a46a387966fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d043b-7aef-426d-ba23-a46a387966fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7111faf-6708-4b17-8ba0-78988cd7c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7111faf-6708-4b17-8ba0-78988cd7c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2136629f-b1c0-4269-a97d-9381c86a92ef', 'volume_name': 'volume-2136629f-b1c0-4269-a97d-9381c86a92ef', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9055cc7-538c-4429-83ab-22684cad0cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9055cc7-538c-4429-83ab-22684cad0cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade450f9-9132-4c09-b7c5-e881b9712f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:08 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Volume 2136629f-b1c0-4269-a97d-9381c86a92ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2136629f-b1c0-4269-a97d-9381c86a92ef', 'volume_size': 1} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:08 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fc40ca5a-f34b-4fee-933e-b1dc10323cf7" returned: 0 in 0.929s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Lock "cinder-quobyte-fc40ca5a-f34b-4fee-933e-b1dc10323cf7" released by "delete_volume" :: held 1.859s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.quota [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Created reservations ['05631a80-fc8c-4a74-af7b-655ed36a434f', 'c2066b1c-b372-48c4-ad5e-6023110c8e07', '09adc60e-c94d-4e91-b53c-967605c80372', 'f602bda3-ee6f-4ab6-b9e7-195aafe39185'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:08 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:08 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:09 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.129s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:09 devstack cinder-volume[87449]: DEBUG cinder.manager [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Deleted volume successfully. Jul 10 05:53:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d9891f04-e383-4b07-a792-0db27fc94a0d req-ef72e863-5843-4346-acfd-2045e6d44278 tempest-VolumesGetTestJSON-1568779631 None] Lock "cinder-fc40ca5a-f34b-4fee-933e-b1dc10323cf7-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:14 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" returned: 0 in 6.210s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:14 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e44cd-5bfb-4c85-a98d-bc08c0cbdb3d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:14 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:53:14 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:15 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 0.937s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:53:15 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Converted 1024.00 MB image at 164.86 MB/s Jul 10 05:53:15 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 is being set with open permissions: ugo+rw Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:15 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 Jul 10 05:53:15 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:15 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Flow 'volume_create_manager' (1a764daa-1c05-409f-9284-42c8a7129a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce83769-a540-4b1f-be50-79c0762bec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce83769-a540-4b1f-be50-79c0762bec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-631430598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ecfac4-0474-4dc6-915f-8059ba955c1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e11498277aa4c6fa5b8abdec54097c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:16Z,use_quota=True,user_id='d22ae269766e41a3902b1aec65832899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815b5dbd-7222-4757-90bd-b1254c536174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815b5dbd-7222-4757-90bd-b1254c536174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba06ed3-074e-4a2c-ab29-91c49ccc6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba06ed3-074e-4a2c-ab29-91c49ccc6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61ecfac4-0474-4dc6-915f-8059ba955c1d', 'volume_name': 'volume-61ecfac4-0474-4dc6-915f-8059ba955c1d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5abf24f-a558-47b3-9010-a00c50d29a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5abf24f-a558-47b3-9010-a00c50d29a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98417c6-9224-4208-b597-d7faf3a283d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Volume 61ecfac4-0474-4dc6-915f-8059ba955c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61ecfac4-0474-4dc6-915f-8059ba955c1d', 'volume_size': 1} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" released by "_copy_volume_from_snapshot" :: held 10.307s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-27478657-0dc0-4ba3-a6b1-80c03163191e-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" released by "_create_volume_from_snapshot" :: held 10.377s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.445s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.762s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f0753a3-7302-4f79-a9ea-8174d27c0ef8,created_at=2026-07-10T03:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424801225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0753a3-7302-4f79-a9ea-8174d27c0ef8,host='devstack@QuobyteHD#QuobyteHD',id=2136629f-b1c0-4269-a97d-9381c86a92ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:08Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23b3f57a-715d-4cf4-a24d-a751b221abdb),volume_type_id=23b3f57a-715d-4cf4-a24d-a751b221abdb)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Creating volume 2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:15 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:15 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef 1073741824 Jul 10 05:53:15 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e26f2f-f7f4-47ca-8870-965f0a5ed563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40', 'volume_size': 1, 'snapshot_id': '27478657-0dc0-4ba3-a6b1-80c03163191e'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c0538f-e5d1-4009-af32-57ffaa2513ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Volume volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 (aec3ef1e-156d-4a06-ab16-ed644a1a1a40): created successfully Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c0538f-e5d1-4009-af32-57ffaa2513ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Flow 'volume_create_manager' (db334da7-8115-41fe-80f1-0769804aa3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b57072e3-acb7-4137-977e-3ad6a327b1ea tempest-VolumesSnapshotTestJSON-1300574729 None] Created volume successfully. Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-aec3ef1e-156d-4a06-ab16-ed644a1a1a40-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-aec3ef1e-156d-4a06-ab16-ed644a1a1a40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=106,cinder:UPDATE=112,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=102,cinder:DELETE=6,cinder:UPDATE=114,cinder:INSERT=24 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dfbc5e-772e-4dd7-804d-d203daf61dca]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:16 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 Jul 10 05:53:16 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:16 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef 1073741824" returned: 0 in 0.880s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:16 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef Jul 10 05:53:16 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:17 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" returned: 0 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:17 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40 Jul 10 05:53:17 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:17 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef" returned: 0 in 0.674s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-631430598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ecfac4-0474-4dc6-915f-8059ba955c1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e11498277aa4c6fa5b8abdec54097c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:16Z,use_quota=True,user_id='d22ae269766e41a3902b1aec65832899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Creating volume 61ecfac4-0474-4dc6-915f-8059ba955c1d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:17 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:17 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d 1073741824 Jul 10 05:53:17 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade450f9-9132-4c09-b7c5-e881b9712f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2136629f-b1c0-4269-a97d-9381c86a92ef', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b16c2d-4e66-46d6-a8d3-69cea35d2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:17 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Volume volume-2136629f-b1c0-4269-a97d-9381c86a92ef (2136629f-b1c0-4269-a97d-9381c86a92ef): created successfully Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b16c2d-4e66-46d6-a8d3-69cea35d2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (afa4b3c9-0834-4a11-872e-90ef0badac71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4f959627-2184-45c4-ab44-4a8d28e867b2 tempest-GroupSnapshotsTest-468388524 None] Created volume successfully. Jul 10 05:53:17 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" returned: 0 in 0.671s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-aec3ef1e-156d-4a06-ab16-ed644a1a1a40" released by "delete_volume" :: held 1.490s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['039d7cba-53a7-4f88-8507-66b59f370694', 'c5764f38-fc97-4e11-b4af-4c082216040f', 'cf128fb6-3664-4253-a392-abeae8cf127f', 'cceff6f2-bcc0-4029-a65e-9004b197bcde'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:18 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:18 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:18 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d 1073741824" returned: 0 in 0.980s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:18 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d Jul 10 05:53:18 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-27478657-0dc0-4ba3-a6b1-80c03163191e-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-27478657-0dc0-4ba3-a6b1-80c03163191e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-27478657-0dc0-4ba3-a6b1-80c03163191e" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-27478657-0dc0-4ba3-a6b1-80c03163191e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Deleting offline snapshot 27478657-0dc0-4ba3-a6b1-80c03163191e of volume 0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] snapshot_file for this snap is: volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[42699375-ea82-4dec-9794-0be4fecf56df]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:19 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.140s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Deleted volume successfully. Jul 10 05:53:19 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e Jul 10 05:53:19 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-92e3ee8e-3f18-4c67-b997-5ea62534c534 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-aec3ef1e-156d-4a06-ab16-ed644a1a1a40-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:19 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d" returned: 0 in 1.122s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98417c6-9224-4208-b597-d7faf3a283d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ecfac4-0474-4dc6-915f-8059ba955c1d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbee3f9-fbb5-4f29-8ae8-e6e8101d9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (cc84aa5f-d631-487f-871b-9321f15eb846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3156123-bdac-4249-8869-af84f3cc92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Volume volume-61ecfac4-0474-4dc6-915f-8059ba955c1d (61ecfac4-0474-4dc6-915f-8059ba955c1d): created successfully Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbee3f9-fbb5-4f29-8ae8-e6e8101d9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Flow 'volume_create_manager' (1a764daa-1c05-409f-9284-42c8a7129a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3156123-bdac-4249-8869-af84f3cc92ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55491511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0753a3-7302-4f79-a9ea-8174d27c0ef8,host='devstack@QuobyteHD#QuobyteHD',id=4af24552-467b-423c-acef-b3f4d15c476f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:20Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23b3f57a-715d-4cf4-a24d-a751b221abdb),volume_type_id=23b3f57a-715d-4cf4-a24d-a751b221abdb)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caefd6d1-bfe9-4fe3-b462-bba784aab23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caefd6d1-bfe9-4fe3-b462-bba784aab23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302a702f-ed42-4962-9184-2a68e2163aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302a702f-ed42-4962-9184-2a68e2163aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af24552-467b-423c-acef-b3f4d15c476f', 'volume_name': 'volume-4af24552-467b-423c-acef-b3f4d15c476f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c96cd9-3d35-4377-a628-9390488d9f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c96cd9-3d35-4377-a628-9390488d9f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca94d2a3-9fff-4ca2-8986-064a7a2eaaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Volume 4af24552-467b-423c-acef-b3f4d15c476f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af24552-467b-423c-acef-b3f4d15c476f', 'volume_size': 1} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f0753a3-7302-4f79-a9ea-8174d27c0ef8,created_at=2026-07-10T03:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55491511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f0753a3-7302-4f79-a9ea-8174d27c0ef8,host='devstack@QuobyteHD#QuobyteHD',id=4af24552-467b-423c-acef-b3f4d15c476f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:20Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23b3f57a-715d-4cf4-a24d-a751b221abdb),volume_type_id=23b3f57a-715d-4cf4-a24d-a751b221abdb)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Creating volume 4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:19 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d64dd7e8-fcbb-4218-923c-b63d4eab000d tempest-VolumesTestJSON-567453022 None] Created volume successfully. Jul 10 05:53:19 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f 1073741824 Jul 10 05:53:19 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:20 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e" returned: 0 in 1.103s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a0b0b-f1b1-48c5-ac59-580cfc8efa54]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:20 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:53:20 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Flow 'volume_create_manager' (133e2bb8-009f-47d9-a06c-68f87b7dfc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca2aa71-0680-49ed-85d9-8e9731ef49a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca2aa71-0680-49ed-85d9-8e9731ef49a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1175662227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2b4623-aecf-4a51-9058-b246477d2764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e11498277aa4c6fa5b8abdec54097c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:21Z,use_quota=True,user_id='d22ae269766e41a3902b1aec65832899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabba56b-3aef-431c-98c4-60e5ae621e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabba56b-3aef-431c-98c4-60e5ae621e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5cd5da-87f1-4b4f-ad6b-6cfbd11b033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5cd5da-87f1-4b4f-ad6b-6cfbd11b033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2b4623-aecf-4a51-9058-b246477d2764', 'volume_name': 'volume-ae2b4623-aecf-4a51-9058-b246477d2764', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090364f6-c5e8-4c79-9e47-863df119f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090364f6-c5e8-4c79-9e47-863df119f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdbe5b7-d852-4d03-a819-a6fbf813f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Volume ae2b4623-aecf-4a51-9058-b246477d2764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2b4623-aecf-4a51-9058-b246477d2764', 'volume_size': 1} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:21 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f 1073741824" returned: 0 in 1.313s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:21 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f Jul 10 05:53:21 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:21 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 1.155s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:21 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e Jul 10 05:53:21 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:21 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f" returned: 0 in 0.670s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1175662227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2b4623-aecf-4a51-9058-b246477d2764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e11498277aa4c6fa5b8abdec54097c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:21Z,use_quota=True,user_id='d22ae269766e41a3902b1aec65832899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Creating volume ae2b4623-aecf-4a51-9058-b246477d2764 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:21 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca94d2a3-9fff-4ca2-8986-064a7a2eaaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af24552-467b-423c-acef-b3f4d15c476f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:21 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 1073741824 Jul 10 05:53:21 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f129ab2-6293-4123-a00c-bfa85f1ddfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Volume volume-4af24552-467b-423c-acef-b3f4d15c476f (4af24552-467b-423c-acef-b3f4d15c476f): created successfully Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f129ab2-6293-4123-a00c-bfa85f1ddfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (cc84aa5f-d631-487f-871b-9321f15eb846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:21 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-067a0f5e-2748-443c-a491-ee04aadc9a6e tempest-GroupSnapshotsTest-468388524 None] Created volume successfully. Jul 10 05:53:22 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e" returned: 0 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:22 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e Jul 10 05:53:22 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1ec5e378-e029-415b-9f03-71ff4c656fc9 tempest-GroupSnapshotsTest-468388524 None] Update group completed successfully. Jul 10 05:53:22 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 1073741824" returned: 0 in 0.858s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:22 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 Jul 10 05:53:22 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:22 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7.27478657-0dc0-4ba3-a6b1-80c03163191e" returned: 0 in 0.692s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-27478657-0dc0-4ba3-a6b1-80c03163191e" released by "_delete_snapshot" :: held 3.914s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" released by "delete_snapshot" :: held 3.960s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['d234b59d-65ce-458a-87cc-1a8f378e301f', '46447cfe-f2bc-4842-ba2a-b9b73fe806e2', '6a211159-8a3e-4b31-a9d6-bac387416afc', '9a84c60f-bc5e-4b32-be89-06663b894f22'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Delete snapshot completed successfully. Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a0d05a4a-50e7-4d2f-addf-5a49101f5f79 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-27478657-0dc0-4ba3-a6b1-80c03163191e-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-0f6e1144-4b39-48f0-b48c-a8a74b4928a7-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-0f6e1144-4b39-48f0-b48c-a8a74b4928a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[db44c2b3-7870-4060-bd0c-d28f4234e48f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:23 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764" returned: 0 in 0.702s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdbe5b7-d852-4d03-a819-a6fbf813f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2b4623-aecf-4a51-9058-b246477d2764', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1f751f-382d-40b2-932b-f736b6fed079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:23 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:53:23 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:23 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Volume volume-ae2b4623-aecf-4a51-9058-b246477d2764 (ae2b4623-aecf-4a51-9058-b246477d2764): created successfully Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1f751f-382d-40b2-932b-f736b6fed079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Flow 'volume_create_manager' (133e2bb8-009f-47d9-a06c-68f87b7dfc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-63f56f7e-1eae-4256-8e11-8ccac263ddcf tempest-VolumesTestJSON-567453022 None] Created volume successfully. Jul 10 05:53:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e8f64ec5-0c21-421c-97a2-f0d11ccaf518 tempest-GroupSnapshotsTest-468388524 None] Update group completed successfully. Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 0.783s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:24 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:24 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7 Jul 10 05:53:24 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Flow 'volume_create_manager' (0967186f-67f7-4995-b481-90d0f87a1cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59f0c80-8919-41ed-9f6f-6747a2cb3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59f0c80-8919-41ed-9f6f-6747a2cb3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-135711207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effa38e4-a652-45e9-b635-bd476d297b80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e11498277aa4c6fa5b8abdec54097c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:25Z,use_quota=True,user_id='d22ae269766e41a3902b1aec65832899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05832f62-5e6b-4dee-b98e-78a0c9897db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05832f62-5e6b-4dee-b98e-78a0c9897db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83beb0f7-e544-446d-81b8-5079cfa53fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83beb0f7-e544-446d-81b8-5079cfa53fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effa38e4-a652-45e9-b635-bd476d297b80', 'volume_name': 'volume-effa38e4-a652-45e9-b635-bd476d297b80', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a80c950-7405-43cc-8bb6-2568451b6f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a80c950-7405-43cc-8bb6-2568451b6f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6638da-57ed-4e97-97d5-a743b6596ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Volume effa38e4-a652-45e9-b635-bd476d297b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effa38e4-a652-45e9-b635-bd476d297b80', 'volume_size': 1} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-135711207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effa38e4-a652-45e9-b635-bd476d297b80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e11498277aa4c6fa5b8abdec54097c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:25Z,use_quota=True,user_id='d22ae269766e41a3902b1aec65832899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Creating volume effa38e4-a652-45e9-b635-bd476d297b80 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:24 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:24 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 1073741824 Jul 10 05:53:24 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6e6939bc-003b-4aee-8b57-eebe4a577ec2 tempest-GroupSnapshotsTest-468388524 None] Update group completed successfully. Jul 10 05:53:25 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" returned: 0 in 1.146s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-0f6e1144-4b39-48f0-b48c-a8a74b4928a7" released by "delete_volume" :: held 1.989s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['906117f0-03c7-4570-81a4-f3bc167a44ee', '3137f798-0bff-4d1c-8a4c-44a9134bc682', 'b552cd68-dba7-44ad-a580-c9ce501f35ab', 'd92deaf1-3c93-43cd-901a-e846cc26e13e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:25 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:25 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-ed39a3f5-0cf8-4186-a60a-8eb222593ff5-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-ed39a3f5-0cf8-4186-a60a-8eb222593ff5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "cinder-quobyte-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832ee4d-87be-4266-b79c-56ed1171e8ec]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:25 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 1073741824" returned: 0 in 1.164s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:26 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 Jul 10 05:53:26 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:26 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 Jul 10 05:53:26 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9c61cc07-0063-4318-8b0d-3eed7875a1ec tempest-GroupSnapshotsTest-468388524 None] Update group completed successfully. Jul 10 05:53:26 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.911s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Deleted volume successfully. Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2cf16051-28b6-4e5c-a818-cbeadb440ae6 tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-0f6e1144-4b39-48f0-b48c-a8a74b4928a7-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:26 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80" returned: 0 in 0.790s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:26 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6638da-57ed-4e97-97d5-a743b6596ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effa38e4-a652-45e9-b635-bd476d297b80', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d948a98-0735-4fc0-a5e1-7a9b0aaff523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" returned: 0 in 1.053s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Volume volume-effa38e4-a652-45e9-b635-bd476d297b80 (effa38e4-a652-45e9-b635-bd476d297b80): created successfully Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d948a98-0735-4fc0-a5e1-7a9b0aaff523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:26 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5 Jul 10 05:53:26 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Flow 'volume_create_manager' (0967186f-67f7-4995-b481-90d0f87a1cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4b0443dd-fed4-4179-b3d4-773b78ea2d3a tempest-VolumesTestJSON-567453022 None] Created volume successfully. Jul 10 05:53:27 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-quobyte-ed39a3f5-0cf8-4186-a60a-8eb222593ff5" released by "delete_volume" :: held 1.886s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] GroupSnapshot a9091840-b0bc-4671-be53-0075bcc9b06e: creating. Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Created reservations ['3dedbdac-a970-4596-87e2-5ef4c6cf2c0e', 'be1e8089-b95a-4bf3-954a-590549654fb6', '9cb54824-9ef8-452f-acfa-cc228ffcb468', '415e8bdc-bb36-42b9-b794-75e87541cf4f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Group snapshot a9091840-b0bc-4671-be53-0075bcc9b06e: creating. {{(pid=87449) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Creating offline snapshot 6bca3642-71ef-467a-b70c-a1ba8190d313 of volume 4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046f0f2-bbe3-4587-ba35-da40db0a6a42]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:27 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:27 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:28 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f Jul 10 05:53:28 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:28 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:28 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:29 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.278s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:29 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f" returned: 0 in 1.335s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Deleted volume successfully. Jul 10 05:53:29 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 1G Jul 10 05:53:29 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51423042-a7c6-4e04-bb87-09525b51feeb tempest-VolumesSnapshotTestJSON-1300574729 None] Lock "cinder-ed39a3f5-0cf8-4186-a60a-8eb222593ff5-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Acquiring lock "cinder-effa38e4-a652-45e9-b635-bd476d297b80-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Lock "cinder-effa38e4-a652-45e9-b635-bd476d297b80-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Acquiring lock "cinder-quobyte-effa38e4-a652-45e9-b635-bd476d297b80" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Lock "cinder-quobyte-effa38e4-a652-45e9-b635-bd476d297b80" acquired by "delete_volume" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e6f485-c78c-427c-adff-41c59da2f37f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:30 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.153s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:53:30 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 Jul 10 05:53:30 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:30 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 1G" returned: 0 in 1.500s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af24552-467b-423c-acef-b3f4d15c476f -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:30 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af24552-467b-423c-acef-b3f4d15c476f -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 Jul 10 05:53:30 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:31 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80" returned: 0 in 1.059s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:31 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80 Jul 10 05:53:31 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:31 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af24552-467b-423c-acef-b3f4d15c476f -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313" returned: 0 in 1.004s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:31 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:53:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:31 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 Jul 10 05:53:31 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:32 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-effa38e4-a652-45e9-b635-bd476d297b80" returned: 0 in 1.124s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Lock "cinder-quobyte-effa38e4-a652-45e9-b635-bd476d297b80" released by "delete_volume" :: held 2.269s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Created reservations ['2bb073ad-8d31-427a-9e26-c582a6198dc3', 'cca68919-55aa-40e0-be6b-225e78d9fcc8', 'ec664315-61b8-4a2b-a0b9-6ba1187228a0', 'b2359254-0559-45ca-9048-e10a064b9e34'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:32 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:32 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:32 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313" returned: 0 in 1.104s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:32 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info Jul 10 05:53:32 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Acquiring lock "cinder-ae2b4623-aecf-4a51-9058-b246477d2764-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Lock "cinder-ae2b4623-aecf-4a51-9058-b246477d2764-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Acquiring lock "cinder-quobyte-ae2b4623-aecf-4a51-9058-b246477d2764" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Lock "cinder-quobyte-ae2b4623-aecf-4a51-9058-b246477d2764" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e0fd1f-9503-44e3-b3bd-7645a948b570]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:33 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.243s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Deleted volume successfully. Jul 10 05:53:33 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 Jul 10 05:53:33 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f08e0cfc-4e80-4e79-a5e4-1efea8637dfe tempest-VolumesTestJSON-567453022 None] Lock "cinder-effa38e4-a652-45e9-b635-bd476d297b80-delete_volume" released by "delete_volume" :: held 3.996s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:34 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info" returned: 0 in 1.110s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:34 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:53:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:34 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info Jul 10 05:53:34 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:34 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764" returned: 0 in 1.247s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:34 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764 Jul 10 05:53:34 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:35 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.info" returned: 0 in 0.980s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.199s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Creating offline snapshot e55046a5-4176-4c98-91f0-c79b152f05a7 of volume 2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf24e9c-2c5d-4552-aeb1-9898052fb85e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:35 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef Jul 10 05:53:35 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:35 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2b4623-aecf-4a51-9058-b246477d2764" returned: 0 in 0.881s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Lock "cinder-quobyte-ae2b4623-aecf-4a51-9058-b246477d2764" released by "delete_volume" :: held 2.184s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Created reservations ['e11488b4-290f-43ad-a2d8-33cee711cd75', 'a6057013-bae7-49f4-a7e5-606937c97db5', '291db0bf-6547-44b8-b394-31aa283f92f8', '76056499-0044-45e2-bab0-6ec87265a1be'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:35 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:35 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:36 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef" returned: 0 in 1.029s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:36 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 1G Jul 10 05:53:36 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:36 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.865s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:36 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Deleted volume successfully. Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14369693-f39c-4c34-b543-7a03fe5ac08a tempest-VolumesTestJSON-567453022 None] Lock "cinder-ae2b4623-aecf-4a51-9058-b246477d2764-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Acquiring lock "cinder-61ecfac4-0474-4dc6-915f-8059ba955c1d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Lock "cinder-61ecfac4-0474-4dc6-915f-8059ba955c1d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Acquiring lock "cinder-quobyte-61ecfac4-0474-4dc6-915f-8059ba955c1d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Lock "cinder-quobyte-61ecfac4-0474-4dc6-915f-8059ba955c1d" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ccc63-1a69-419f-b6f5-4bba5df6f5ef]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:37 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d Jul 10 05:53:37 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:37 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 1G" returned: 0 in 1.094s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2136629f-b1c0-4269-a97d-9381c86a92ef -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:37 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2136629f-b1c0-4269-a97d-9381c86a92ef -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 Jul 10 05:53:37 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:38 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d" returned: 0 in 1.110s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:38 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d Jul 10 05:53:38 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:38 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2136629f-b1c0-4269-a97d-9381c86a92ef -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7" returned: 0 in 0.960s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:38 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:38 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 Jul 10 05:53:38 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:38 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61ecfac4-0474-4dc6-915f-8059ba955c1d" returned: 0 in 0.841s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Lock "cinder-quobyte-61ecfac4-0474-4dc6-915f-8059ba955c1d" released by "delete_volume" :: held 2.002s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:38 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Created reservations ['e4409904-7cea-47ae-bb63-2e6ce6e9322b', '3447481e-ed9d-4821-ac22-854be9365f22', 'b7505f74-c969-4be3-be49-a2689c7426c0', '8aab37d0-51a1-4d81-9afe-1891fe16f852'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:39 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:39 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:39 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7" returned: 0 in 1.094s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:39 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info Jul 10 05:53:39 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:40 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.017s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Deleted volume successfully. Jul 10 05:53:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2486af9f-dcb7-46a7-bfae-8963eb5c025f tempest-VolumesTestJSON-567453022 None] Lock "cinder-61ecfac4-0474-4dc6-915f-8059ba955c1d-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:40 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info" returned: 0 in 1.064s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:40 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:53:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:40 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info Jul 10 05:53:40 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:41 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.info" returned: 0 in 0.717s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.091s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9a70d9b5-c733-49e3-8f34-ce9ad2f24ca5 tempest-GroupSnapshotsTest-468388524 None] group_snapshot a9091840-b0bc-4671-be53-0075bcc9b06e: created successfully Jul 10 05:53:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] group_snapshot a9091840-b0bc-4671-be53-0075bcc9b06e: deleting Jul 10 05:53:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] group_snapshot a9091840-b0bc-4671-be53-0075bcc9b06e: deleting {{(pid=87449) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-4af24552-467b-423c-acef-b3f4d15c476f" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-4af24552-467b-423c-acef-b3f4d15c476f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-6bca3642-71ef-467a-b70c-a1ba8190d313" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-6bca3642-71ef-467a-b70c-a1ba8190d313" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Deleting offline snapshot 6bca3642-71ef-467a-b70c-a1ba8190d313 of volume 4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] snapshot_file for this snap is: volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b967c7-30c8-4e95-8f73-9929bf49b772]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:42 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 Jul 10 05:53:42 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:43 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313" returned: 0 in 1.066s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af24552-467b-423c-acef-b3f4d15c476f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:53:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3aca38-ec8c-4e1c-bd82-f8f1dd214161]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:43 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f Jul 10 05:53:43 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:43 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f" returned: 0 in 0.776s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:43 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 Jul 10 05:53:43 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43ec83aa-cc75-4e9e-b184-9816b78a3eb2 tempest-BackendsCapabilitiesAdminTestsJSON-596551277 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87449) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 05:53:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-eb0e3226-ba21-4b4a-94a2-8b687223b072 tempest-BackendsCapabilitiesAdminTestsJSON-596551277 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87449) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 05:53:44 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313" returned: 0 in 0.822s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:44 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313 Jul 10 05:53:44 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:45 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f.6bca3642-71ef-467a-b70c-a1ba8190d313" returned: 0 in 0.710s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-6bca3642-71ef-467a-b70c-a1ba8190d313" released by "_delete_snapshot" :: held 3.496s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-4af24552-467b-423c-acef-b3f4d15c476f" released by "delete_snapshot" :: held 3.521s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-2136629f-b1c0-4269-a97d-9381c86a92ef" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-2136629f-b1c0-4269-a97d-9381c86a92ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-e55046a5-4176-4c98-91f0-c79b152f05a7" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-e55046a5-4176-4c98-91f0-c79b152f05a7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Deleting offline snapshot e55046a5-4176-4c98-91f0-c79b152f05a7 of volume 2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] snapshot_file for this snap is: volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2febbb8a-ee5c-4902-b68b-8c6d32c41775]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:45 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 Jul 10 05:53:45 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:46 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7" returned: 0 in 0.876s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2136629f-b1c0-4269-a97d-9381c86a92ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:53:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dceec11-e9df-460e-9963-19cbee43c1ab]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:46 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef Jul 10 05:53:46 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:47 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef" returned: 0 in 0.910s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:47 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 Jul 10 05:53:47 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:48 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7" returned: 0 in 1.003s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:48 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7 Jul 10 05:53:48 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:49 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef.e55046a5-4176-4c98-91f0-c79b152f05a7" returned: 0 in 0.975s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-e55046a5-4176-4c98-91f0-c79b152f05a7" released by "_delete_snapshot" :: held 3.913s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-2136629f-b1c0-4269-a97d-9381c86a92ef" released by "delete_snapshot" :: held 3.958s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:49 devstack cinder-volume[87449]: WARNING cinder.quota [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1425712161 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1425712161, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:53:49 devstack cinder-volume[87449]: WARNING cinder.quota [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1425712161 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1425712161, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:53:49 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['9925e9d5-a166-4a8a-a8eb-56f76088ef40', 'e21402c3-6df1-40d9-8d92-7617f9d4bf0e', 'ce86c3f4-3a1e-4246-89a8-ac43a13405a4', '7b3bcb27-2b34-42c9-ba12-53c370be2dd9'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:49 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['4cbb8938-a2b6-45da-a85c-dd6a97ee352c', '407628a4-b8fe-4d9c-88f4-de4c1adc04ad', '89f79865-847d-43df-9a30-238754de2499', '819d3f32-95d1-424a-9bc6-9f11b8b2b790'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1b29be93-da1d-4e53-8a6d-37345cbf6af0 tempest-GroupSnapshotsTest-468388524 None] group_snapshot a9091840-b0bc-4671-be53-0075bcc9b06e: deleted successfully Jul 10 05:53:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-2136629f-b1c0-4269-a97d-9381c86a92ef" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-2136629f-b1c0-4269-a97d-9381c86a92ef" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[833da5c4-0437-4be6-9101-d5be3f153a91]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:51 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef Jul 10 05:53:51 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Flow 'volume_create_manager' (06c9cea3-2ac4-4a43-bf67-df5e53452403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c0dc25-6d9c-4e1e-9933-e0b06643aceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c0dc25-6d9c-4e1e-9933-e0b06643aceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-552931711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3ca318-a4aa-4148-a405-ee23a3600639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a34760da69411c9a3e7ebd38dbcfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:52Z,use_quota=True,user_id='bc7290ecbf794e00bebe2ffc4b2d3b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b45db9-cea3-4367-a9d0-6a62b1589388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b45db9-cea3-4367-a9d0-6a62b1589388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c539f63e-b700-4fba-8080-bc9be5487f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c539f63e-b700-4fba-8080-bc9be5487f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3ca318-a4aa-4148-a405-ee23a3600639', 'volume_name': 'volume-da3ca318-a4aa-4148-a405-ee23a3600639', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e94ce5f-044c-4300-bbf4-31085c2344f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e94ce5f-044c-4300-bbf4-31085c2344f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5b6063-7720-4c73-811c-e1146962bebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Volume da3ca318-a4aa-4148-a405-ee23a3600639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3ca318-a4aa-4148-a405-ee23a3600639', 'volume_size': 1} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-552931711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3ca318-a4aa-4148-a405-ee23a3600639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a34760da69411c9a3e7ebd38dbcfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:52Z,use_quota=True,user_id='bc7290ecbf794e00bebe2ffc4b2d3b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Creating volume da3ca318-a4aa-4148-a405-ee23a3600639 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:52 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:52 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 1073741824 Jul 10 05:53:52 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:52 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef" returned: 0 in 1.054s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:52 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef Jul 10 05:53:52 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:53 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2136629f-b1c0-4269-a97d-9381c86a92ef" returned: 0 in 0.791s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-2136629f-b1c0-4269-a97d-9381c86a92ef" released by "delete_volume" :: held 1.934s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-4af24552-467b-423c-acef-b3f4d15c476f" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-4af24552-467b-423c-acef-b3f4d15c476f" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0680f641-59ed-4668-9c87-47a764395029]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:53 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f Jul 10 05:53:53 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:53 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 1073741824" returned: 0 in 1.317s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:53 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 Jul 10 05:53:53 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:54 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f" returned: 0 in 1.090s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:54 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f Jul 10 05:53:54 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:54 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639" returned: 0 in 0.955s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5b6063-7720-4c73-811c-e1146962bebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3ca318-a4aa-4148-a405-ee23a3600639', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9bd40e-1158-48e7-934c-836d9f0ef2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:54 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Volume volume-da3ca318-a4aa-4148-a405-ee23a3600639 (da3ca318-a4aa-4148-a405-ee23a3600639): created successfully Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9bd40e-1158-48e7-934c-836d9f0ef2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Flow 'volume_create_manager' (06c9cea3-2ac4-4a43-bf67-df5e53452403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5dfec872-bb27-4ff2-bc40-ad50cd22a213 tempest-AttachVolumeShelveTestJSON-1063625589 None] Created volume successfully. Jul 10 05:53:55 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4af24552-467b-423c-acef-b3f4d15c476f" returned: 0 in 0.938s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-4af24552-467b-423c-acef-b3f4d15c476f" released by "delete_volume" :: held 2.116s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['f0db6e61-e522-4e99-bd4f-4fc11f59b33e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:55 devstack cinder-volume[87449]: WARNING cinder.quota [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1425712161 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1425712161, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['a59f197f-750f-4357-8e03-912284559b65', 'f7f2292e-f554-43cb-847c-c00014c12f0d', 'f3a1028b-0cff-4684-944a-1945b64cd1bd', 'f1c4c694-5af3-432e-b621-2a00aaf5895e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['a5dff16e-8993-45bc-af5e-7a9444c56a7b', '796395be-5e16-429b-9443-6f5e580e2156', '395010ce-a251-4ebd-95fe-cf7a46f8d92e', '8e2e96ff-1dcc-4138-a24f-b2107cfb1cbd'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:56 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:53:56 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:53:57 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 10 05:53:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.071s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:53:57 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:53:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-665a77e2-b228-4983-8f9d-69948ad3e1a0 tempest-GroupSnapshotsTest-468388524 None] Delete group completed successfully. Jul 10 05:53:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-486747d3-85b7-4e6e-9466-8a1fe5305c53 tempest-GroupSnapshotsTest-468388524 None] Group tempest-GroupSnapshotsTest-Group-846661452: creating Jul 10 05:53:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-486747d3-85b7-4e6e-9466-8a1fe5305c53 tempest-GroupSnapshotsTest-468388524 None] Group tempest-GroupSnapshotsTest-Group-846661452: created successfully Jul 10 05:53:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-486747d3-85b7-4e6e-9466-8a1fe5305c53 tempest-GroupSnapshotsTest-468388524 None] Create group completed successfully. Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (d4fc6fa8-ccaf-46e9-b4e8-e265a376887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd96732-2302-4a32-b924-3ab55c4b7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd96732-2302-4a32-b924-3ab55c4b7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641164254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5682f008-4782-4ab9-9925-a81f0a218f09,host='devstack@QuobyteHD#QuobyteHD',id=ea2b908c-7e40-4d3e-b8d8-d49071924fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:59Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a3b4db2-efce-45e1-9c95-6122473a21cf),volume_type_id=1a3b4db2-efce-45e1-9c95-6122473a21cf)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063fed61-1541-4b4a-82de-f4415217ceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063fed61-1541-4b4a-82de-f4415217ceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7049e75-e3dd-45b3-9849-5255cff5d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7049e75-e3dd-45b3-9849-5255cff5d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2b908c-7e40-4d3e-b8d8-d49071924fdc', 'volume_name': 'volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a629e10d-660a-416b-89cc-316962993752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a629e10d-660a-416b-89cc-316962993752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30ff16a-1d03-4669-9530-95e7a2eb2c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:53:59 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Volume ea2b908c-7e40-4d3e-b8d8-d49071924fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc', 'volume_size': 1} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5682f008-4782-4ab9-9925-a81f0a218f09,created_at=2026-07-10T03:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641164254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5682f008-4782-4ab9-9925-a81f0a218f09,host='devstack@QuobyteHD#QuobyteHD',id=ea2b908c-7e40-4d3e-b8d8-d49071924fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c9aeaf9ef749c8a94881b6c49f2622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:53:59Z,use_quota=True,user_id='a6f4afc13a964a7d92f8e45cad923e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a3b4db2-efce-45e1-9c95-6122473a21cf),volume_type_id=1a3b4db2-efce-45e1-9c95-6122473a21cf)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Creating volume ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:53:59 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:53:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:53:59 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc 1073741824 Jul 10 05:53:59 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:00 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc 1073741824" returned: 0 in 1.104s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:00 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc Jul 10 05:54:00 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:01 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" returned: 0 in 0.940s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Flow 'volume_create_manager' (da691f01-328b-4476-bf11-5f07340c052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea60a797-1ba8-4496-8fdc-bdbbf2bab6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea60a797-1ba8-4496-8fdc-bdbbf2bab6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1298667836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10ef8bf-3223-4981-96a8-d7afc84a58fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9386785790b740e281edfd50edfecd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:01Z,use_quota=True,user_id='7f17e39eddd9443390a49def4853f4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9eaf0ab-52f6-4e89-b522-94968c422326),volume_type_id=d9eaf0ab-52f6-4e89-b522-94968c422326)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c94b161-c31e-459e-aae9-1104db203096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c94b161-c31e-459e-aae9-1104db203096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f05182-ed0b-41e7-835f-78cb28d30b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f05182-ed0b-41e7-835f-78cb28d30b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10ef8bf-3223-4981-96a8-d7afc84a58fc', 'volume_name': 'volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7eab69-3377-4a52-8745-5d78a1dd11e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7eab69-3377-4a52-8745-5d78a1dd11e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f5d903-47fe-46f8-aa87-621f0606c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Volume f10ef8bf-3223-4981-96a8-d7afc84a58fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc', 'volume_size': 1} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1298667836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10ef8bf-3223-4981-96a8-d7afc84a58fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9386785790b740e281edfd50edfecd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:01Z,use_quota=True,user_id='7f17e39eddd9443390a49def4853f4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9eaf0ab-52f6-4e89-b522-94968c422326),volume_type_id=d9eaf0ab-52f6-4e89-b522-94968c422326)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Creating volume f10ef8bf-3223-4981-96a8-d7afc84a58fc {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:54:01 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30ff16a-1d03-4669-9530-95e7a2eb2c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a136b954-1e82-4095-b115-4b9a15ed7fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:01 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc 1073741824 Jul 10 05:54:01 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Volume volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc (ea2b908c-7e40-4d3e-b8d8-d49071924fdc): created successfully Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a136b954-1e82-4095-b115-4b9a15ed7fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Flow 'volume_create_manager' (d4fc6fa8-ccaf-46e9-b4e8-e265a376887f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-50123de0-2cdf-464a-b7ea-7a441d545669 tempest-GroupSnapshotsTest-468388524 None] Created volume successfully. Jul 10 05:54:02 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc 1073741824" returned: 0 in 1.111s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:02 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc Jul 10 05:54:02 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] GroupSnapshot 3731212a-e5dc-405e-94f0-ccd5beb3a6fc: creating. Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Group snapshot 3731212a-e5dc-405e-94f0-ccd5beb3a6fc: creating. {{(pid=87449) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:03 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc" returned: 0 in 0.980s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.153s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Creating offline snapshot 22dfbc08-abf8-42c7-87de-99b6c20cf3e6 of volume ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f5d903-47fe-46f8-aa87-621f0606c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2306281-9a8e-4d60-806e-df084a0ffd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ee449-6b22-4eb4-a54e-a5b077563cd1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:03 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Volume volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc (f10ef8bf-3223-4981-96a8-d7afc84a58fc): created successfully Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2306281-9a8e-4d60-806e-df084a0ffd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Flow 'volume_create_manager' (da691f01-328b-4476-bf11-5f07340c052b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8bfb9aa2-9097-4bbc-bc51-f74c51f8077f tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Created volume successfully. Jul 10 05:54:03 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc Jul 10 05:54:03 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:04 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" returned: 0 in 0.987s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:04 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 1G Jul 10 05:54:04 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:05 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:54:05 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:05 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 1G" returned: 0 in 1.270s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:06 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 Jul 10 05:54:06 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Flow 'volume_create_manager' (c005739b-85c5-4e5d-a80e-0b9a345fe676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7e66e-ffe3-458a-9aed-c8a4723f00c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:06 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.866s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7e66e-ffe3-458a-9aed-c8a4723f00c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-247201976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6903c92f-58b6-4154-a714-6e53e40889b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814f2e929dda4f2eabd66a93c2ecdc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:06Z,use_quota=True,user_id='44a7fc2b062940e793c5948cb715628b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b838e6-ed39-415c-a43e-f8e62fb8e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b838e6-ed39-415c-a43e-f8e62fb8e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a21e2f-0174-4712-81de-50fab6a132d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a21e2f-0174-4712-81de-50fab6a132d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6903c92f-58b6-4154-a714-6e53e40889b8', 'volume_name': 'volume-6903c92f-58b6-4154-a714-6e53e40889b8', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78533336-d6a7-43a8-a6c5-1049f2c5908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78533336-d6a7-43a8-a6c5-1049f2c5908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835561d0-457f-4f34-acbe-c06decb6d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:06 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Volume 6903c92f-58b6-4154-a714-6e53e40889b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6903c92f-58b6-4154-a714-6e53e40889b8', 'volume_size': 1} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-da269b09-125c-4967-9b5f-a0b5e4d876d2 tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Retype volume completed successfully. Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Acquiring lock "cinder-f10ef8bf-3223-4981-96a8-d7afc84a58fc-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "cinder-f10ef8bf-3223-4981-96a8-d7afc84a58fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Acquiring lock "cinder-quobyte-f10ef8bf-3223-4981-96a8-d7afc84a58fc" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "cinder-quobyte-f10ef8bf-3223-4981-96a8-d7afc84a58fc" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[02518412-d8c6-4853-9390-e77272f06620]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:06 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc Jul 10 05:54:06 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:06 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6" returned: 0 in 0.891s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:06 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:54:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:06 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 Jul 10 05:54:06 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:07 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc" returned: 0 in 0.915s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:07 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc Jul 10 05:54:07 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:07 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:07 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info Jul 10 05:54:07 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:08 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f10ef8bf-3223-4981-96a8-d7afc84a58fc" returned: 0 in 0.710s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "cinder-quobyte-f10ef8bf-3223-4981-96a8-d7afc84a58fc" released by "delete_volume" :: held 1.665s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:08 devstack cinder-volume[87449]: WARNING cinder.quota [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:08 devstack cinder-volume[87449]: WARNING cinder.quota [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Created reservations ['d78b6c67-0459-431a-82ce-ccff1b5d50f5', '3819d7a1-4cb8-419a-8459-2f6a3d7efafe', '9deab835-6408-4302-aafc-9203ea47e47b', 'b0f00712-ca1c-499c-b26c-0f3ad0e3e070'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:08 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info" returned: 0 in 0.720s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:08 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:54:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:08 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:54:08 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:08 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info Jul 10 05:54:08 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:09 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.969s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:54:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Deleted volume successfully. Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-da3d73b6-9cc1-441e-b0e0-550dcf0c00cf tempest-VolumeRetypeWithoutMigrationTest-981144499 None] Lock "cinder-f10ef8bf-3223-4981-96a8-d7afc84a58fc-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:09 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.info" returned: 0 in 0.998s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.749s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.262s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-247201976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6903c92f-58b6-4154-a714-6e53e40889b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814f2e929dda4f2eabd66a93c2ecdc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:06Z,use_quota=True,user_id='44a7fc2b062940e793c5948cb715628b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Creating volume 6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:54:09 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:54:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:09 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 1073741824 Jul 10 05:54:09 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-da907864-dc94-4345-98b0-bb340f0de1b0 tempest-GroupSnapshotsTest-468388524 None] group_snapshot 3731212a-e5dc-405e-94f0-ccd5beb3a6fc: created successfully Jul 10 05:54:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] group_snapshot 3731212a-e5dc-405e-94f0-ccd5beb3a6fc: deleting Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] group_snapshot 3731212a-e5dc-405e-94f0-ccd5beb3a6fc: deleting {{(pid=87449) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-22dfbc08-abf8-42c7-87de-99b6c20cf3e6" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-22dfbc08-abf8-42c7-87de-99b6c20cf3e6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Deleting offline snapshot 22dfbc08-abf8-42c7-87de-99b6c20cf3e6 of volume ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] snapshot_file for this snap is: volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac12ca-a93b-4dd7-9381-9aba15653f2e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:10 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 Jul 10 05:54:10 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:10 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 1073741824" returned: 0 in 1.231s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:10 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:54:10 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:11 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6" returned: 0 in 0.968s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3b4ac-3955-47fe-9109-b6ce7c5a34eb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:11 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 0.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835561d0-457f-4f34-acbe-c06decb6d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6903c92f-58b6-4154-a714-6e53e40889b8', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b651597-01c5-4a4a-a342-19a0ac0c842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:11 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Volume volume-6903c92f-58b6-4154-a714-6e53e40889b8 (6903c92f-58b6-4154-a714-6e53e40889b8): created successfully Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b651597-01c5-4a4a-a342-19a0ac0c842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Flow 'volume_create_manager' (c005739b-85c5-4e5d-a80e-0b9a345fe676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-38561f87-6eae-4809-8013-9278e218a543 tempest-TestStampPattern-1403787926 None] Created volume successfully. Jul 10 05:54:11 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc Jul 10 05:54:11 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:12 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" returned: 0 in 0.949s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:12 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 Jul 10 05:54:12 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-32cd79d7-0c31-4681-9d32-7b712480a8a1 req-7336a8b3-1645-4428-a0ac-7aaa1b553403 tempest-AttachVolumeShelveTestJSON-1063625589 None] No connector for attachment e31d5039-a14f-4321-ab85-bbcb47892816; skipping storage backend terminate_connection call. {{(pid=87449) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 05:54:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-32cd79d7-0c31-4681-9d32-7b712480a8a1 req-7336a8b3-1645-4428-a0ac-7aaa1b553403 tempest-AttachVolumeShelveTestJSON-1063625589 None] Deleting attachment e31d5039-a14f-4321-ab85-bbcb47892816. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:54:13 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6" returned: 0 in 1.130s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:13 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6 Jul 10 05:54:13 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:14 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc.22dfbc08-abf8-42c7-87de-99b6c20cf3e6" returned: 0 in 0.951s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-22dfbc08-abf8-42c7-87de-99b6c20cf3e6" released by "_delete_snapshot" :: held 4.110s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" released by "delete_snapshot" :: held 4.139s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:14 devstack cinder-volume[87449]: WARNING cinder.quota [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-952160959 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-952160959, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:14 devstack cinder-volume[87449]: WARNING cinder.quota [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-952160959 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-952160959, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:14 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] Created reservations ['871044dd-c442-4d8d-9fd4-9f05c2651866', '68cde89c-4e0c-4bfb-b761-ceb372da22f8', '94403488-96bc-4908-8f9a-8261144c4b52', '808131c1-3ccd-4abb-a53f-6719f018bc7d'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2d8c77c5-cd02-4415-ba11-6a2cf5da0648 tempest-GroupSnapshotsTest-468388524 None] group_snapshot 3731212a-e5dc-405e-94f0-ccd5beb3a6fc: deleted successfully Jul 10 05:54:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "cinder-quobyte-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:15 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7b57a-5747-4bd7-9a7a-b6fb7ad4cfd2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:15 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc Jul 10 05:54:15 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:16 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" returned: 0 in 0.961s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:16 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc Jul 10 05:54:16 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:17 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Lock "cinder-quobyte-ea2b908c-7e40-4d3e-b8d8-d49071924fdc" released by "delete_volume" :: held 1.780s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=113,cinder:UPDATE=144,cinder:DELETE=12,cinder:INSERT=31 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=128,cinder:INSERT=34,cinder:UPDATE=136,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Created reservations ['3641a910-2932-4785-bfed-6d63eff695aa'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:17 devstack cinder-volume[87449]: WARNING cinder.quota [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-952160959 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-952160959, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Created reservations ['11cf29ff-9104-4464-af13-89e59099ff2f', '01952ee0-8e4f-420f-b079-946466e04daf', '2a016de8-9762-41f6-89f0-7de79957bfa1', '1232155a-488c-4487-a476-d1661fa6e79f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:17 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:54:17 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:18 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.724s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:18 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:54:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e594642a-cce5-43fe-88d9-caa53afc6d8e tempest-GroupSnapshotsTest-468388524 None] Delete group completed successfully. Jul 10 05:54:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f0ea0f67-b449-4e46-b93f-2cabde685cd9 tempest-GroupSnapshotsV319Test-530669799 None] Group tempest-GroupSnapshotsV319Test-Group-703905452: creating Jul 10 05:54:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f0ea0f67-b449-4e46-b93f-2cabde685cd9 tempest-GroupSnapshotsV319Test-530669799 None] Group tempest-GroupSnapshotsV319Test-Group-703905452: created successfully Jul 10 05:54:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f0ea0f67-b449-4e46-b93f-2cabde685cd9 tempest-GroupSnapshotsV319Test-530669799 None] Create group completed successfully. Jul 10 05:54:27 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:54:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Flow 'volume_create_manager' (0230c30e-3a46-4939-ab4e-9d0cb2d325c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1d7751-c4a7-46e9-9654-8471b2128585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1d7751-c4a7-46e9-9654-8471b2128585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537151320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64f70d11-9f05-482b-87ae-e9bcdffaff7e,host='devstack@QuobyteHD#QuobyteHD',id=597693ae-5f55-484b-97e7-d86d2e16a844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b42940a6b04c495e8feecb76e664b22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:28Z,use_quota=True,user_id='d7f0f4c79f0d4c09bcf169f9df9426d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(357bc39d-0e8e-4a5d-9778-d02a84641341),volume_type_id=357bc39d-0e8e-4a5d-9778-d02a84641341)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0c0b7f-b91a-4984-a957-8e287288ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0c0b7f-b91a-4984-a957-8e287288ce60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9904fee9-4bf4-4712-bb8f-3a775b02c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9904fee9-4bf4-4712-bb8f-3a775b02c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597693ae-5f55-484b-97e7-d86d2e16a844', 'volume_name': 'volume-597693ae-5f55-484b-97e7-d86d2e16a844', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319ea74d-163b-458f-b4d0-fdda6ed2e428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319ea74d-163b-458f-b4d0-fdda6ed2e428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf17b39-8f9a-4e42-af87-ba968b13a1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:28 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Volume 597693ae-5f55-484b-97e7-d86d2e16a844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597693ae-5f55-484b-97e7-d86d2e16a844', 'volume_size': 1} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64f70d11-9f05-482b-87ae-e9bcdffaff7e,created_at=2026-07-10T03:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537151320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64f70d11-9f05-482b-87ae-e9bcdffaff7e,host='devstack@QuobyteHD#QuobyteHD',id=597693ae-5f55-484b-97e7-d86d2e16a844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b42940a6b04c495e8feecb76e664b22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:28Z,use_quota=True,user_id='d7f0f4c79f0d4c09bcf169f9df9426d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(357bc39d-0e8e-4a5d-9778-d02a84641341),volume_type_id=357bc39d-0e8e-4a5d-9778-d02a84641341)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Creating volume 597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:54:28 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:28 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 1073741824 Jul 10 05:54:28 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:28 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:54:28 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:29 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 1073741824" returned: 0 in 1.478s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:29 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 Jul 10 05:54:29 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:30 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.562s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:54:30 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844" returned: 0 in 1.064s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.622s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf17b39-8f9a-4e42-af87-ba968b13a1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597693ae-5f55-484b-97e7-d86d2e16a844', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020b1fae-fde5-4cc7-842a-afcbb373171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:30 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Volume volume-597693ae-5f55-484b-97e7-d86d2e16a844 (597693ae-5f55-484b-97e7-d86d2e16a844): created successfully Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020b1fae-fde5-4cc7-842a-afcbb373171d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Flow 'volume_create_manager' (0230c30e-3a46-4939-ab4e-9d0cb2d325c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2cdba0c0-6f7d-46e3-9bf9-af3267f0c539 tempest-GroupSnapshotsV319Test-530669799 None] Created volume successfully. Jul 10 05:54:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] GroupSnapshot a4eabe8d-bb99-47e1-8ba2-f0e9581c867d: creating. Jul 10 05:54:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Group snapshot a4eabe8d-bb99-47e1-8ba2-f0e9581c867d: creating. {{(pid=87449) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 05:54:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Creating offline snapshot 0b315687-12e3-42c0-96b6-cf1f3366e6eb of volume 597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:54:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c55e1c-32df-4cfd-a21b-4be61e8f42ea]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:32 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 Jul 10 05:54:32 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:33 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844" returned: 0 in 1.151s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:33 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb 1G Jul 10 05:54:33 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:34 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb 1G" returned: 0 in 1.032s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597693ae-5f55-484b-97e7-d86d2e16a844 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:34 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597693ae-5f55-484b-97e7-d86d2e16a844 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb Jul 10 05:54:34 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:35 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597693ae-5f55-484b-97e7-d86d2e16a844 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb" returned: 0 in 0.830s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:35 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:54:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:35 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb Jul 10 05:54:35 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:36 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb" returned: 0 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:36 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info Jul 10 05:54:36 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info" returned: 0 in 0.802s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:37 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:54:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:37 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:37 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info Jul 10 05:54:37 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:37 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.info" returned: 0 in 0.857s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.484s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b8eb7746-4370-4f88-88c9-3dc09c0bb575 tempest-GroupSnapshotsV319Test-530669799 None] group_snapshot a4eabe8d-bb99-47e1-8ba2-f0e9581c867d: created successfully Jul 10 05:54:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] group_snapshot a4eabe8d-bb99-47e1-8ba2-f0e9581c867d: deleting Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] group_snapshot a4eabe8d-bb99-47e1-8ba2-f0e9581c867d: deleting {{(pid=87449) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "cinder-quobyte-597693ae-5f55-484b-97e7-d86d2e16a844" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Lock "cinder-quobyte-597693ae-5f55-484b-97e7-d86d2e16a844" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "cinder-quobyte-0b315687-12e3-42c0-96b6-cf1f3366e6eb" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Lock "cinder-quobyte-0b315687-12e3-42c0-96b6-cf1f3366e6eb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Deleting offline snapshot 0b315687-12e3-42c0-96b6-cf1f3366e6eb of volume 597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] snapshot_file for this snap is: volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a3adf-2ad1-466e-aa06-b4fe3aebda66]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:39 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb Jul 10 05:54:39 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:41 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb" returned: 0 in 1.550s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-597693ae-5f55-484b-97e7-d86d2e16a844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:54:41 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7fb63-a472-49b5-bb7f-24b44d1cc562]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:41 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 Jul 10 05:54:41 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:42 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844" returned: 0 in 1.275s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:42 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb Jul 10 05:54:42 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:43 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb" returned: 0 in 0.974s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:43 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb Jul 10 05:54:43 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:44 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844.0b315687-12e3-42c0-96b6-cf1f3366e6eb" returned: 0 in 0.692s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Lock "cinder-quobyte-0b315687-12e3-42c0-96b6-cf1f3366e6eb" released by "_delete_snapshot" :: held 4.721s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Lock "cinder-quobyte-597693ae-5f55-484b-97e7-d86d2e16a844" released by "delete_snapshot" :: held 4.760s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:44 devstack cinder-volume[87449]: WARNING cinder.quota [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-70386319 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-70386319, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:44 devstack cinder-volume[87449]: WARNING cinder.quota [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-70386319 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-70386319, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:44 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] Created reservations ['7da44a2f-f71c-4b96-9bb8-843d8089fd86', 'b5ae5130-350e-46ba-8ff0-60067608aa97', '22ed937c-8ae4-4e87-ad0f-b7bcd8c16f98', '21440639-248e-4cca-822b-2d4756dd0eb4'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dbaabc0d-8ada-4218-bb8f-b71c98513eb3 tempest-GroupSnapshotsV319Test-530669799 None] group_snapshot a4eabe8d-bb99-47e1-8ba2-f0e9581c867d: deleted successfully Jul 10 05:54:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "cinder-quobyte-597693ae-5f55-484b-97e7-d86d2e16a844" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:54:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Lock "cinder-quobyte-597693ae-5f55-484b-97e7-d86d2e16a844" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:54:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d46e6-6e94-471d-b029-0f0a86f73e16]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:45 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 Jul 10 05:54:45 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:46 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844" returned: 0 in 0.842s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:46 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844 Jul 10 05:54:46 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:46 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-597693ae-5f55-484b-97e7-d86d2e16a844" returned: 0 in 0.672s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Lock "cinder-quobyte-597693ae-5f55-484b-97e7-d86d2e16a844" released by "delete_volume" :: held 1.596s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:54:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Created reservations ['47dee59a-ed8f-4886-a310-cc8ca373d53e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:46 devstack cinder-volume[87449]: WARNING cinder.quota [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-70386319 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-70386319, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Created reservations ['3b8cabc3-a5ec-4c2d-88a3-68a768ddafc3', '1ce7c0c6-3031-4add-877a-9ea4ae293f8c', 'ff2c048d-ad40-49a6-ba53-23f12f8a9593', '153c4ea6-a84e-4c79-af40-cd1e83f13e76'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:47 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:54:47 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:47 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:47 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:54:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-39476dd0-16b6-416e-84c8-e5fc9ee76678 tempest-GroupSnapshotsV319Test-530669799 None] Delete group completed successfully. Jul 10 05:54:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda48ef-9d7d-4116-869b-7897b8eff829]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:54:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:51 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:54:51 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:52 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 1.042s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.072s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-6903c92f-58b6-4154-a714-6e53e40889b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec775de8-f08f-44fa-bdbb-468ea04f0348', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:54:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-2cb69924-4f55-4e49-aab6-e52d8815357e req-bb024ab5-e9b1-45fb-96b4-dc129617cd51 tempest-TestStampPattern-1403787926 None] attachment_update completed successfully. Jul 10 05:54:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1254c6e8-6bf5-4fe5-a769-65cd5229ec9f tempest-GroupsTest-989375876 None] Group tempest-Group1-523831913: creating Jul 10 05:54:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1254c6e8-6bf5-4fe5-a769-65cd5229ec9f tempest-GroupsTest-989375876 None] Group tempest-Group1-523831913: created successfully Jul 10 05:54:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1254c6e8-6bf5-4fe5-a769-65cd5229ec9f tempest-GroupsTest-989375876 None] Create group completed successfully. Jul 10 05:54:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ad927dce-1b2a-4298-8448-92e30b034463 tempest-GroupsTest-989375876 None] Group tempest-Group2-1922203769: creating Jul 10 05:54:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ad927dce-1b2a-4298-8448-92e30b034463 tempest-GroupsTest-989375876 None] Group tempest-Group2-1922203769: created successfully Jul 10 05:54:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ad927dce-1b2a-4298-8448-92e30b034463 tempest-GroupsTest-989375876 None] Create group completed successfully. Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Flow 'volume_create_manager' (05efb884-8614-4125-980e-b0641e48c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3a9be9-3dc5-46ee-b44a-ccd16d8382ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3a9be9-3dc5-46ee-b44a-ccd16d8382ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987049234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=676b3573-488f-4deb-a37e-13f529117a37,host='devstack@QuobyteHD#QuobyteHD',id=d37bd6b5-6680-445b-9bcb-683ed1eb8622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2b95f9df24ddaad6e9c48af379eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:58Z,use_quota=True,user_id='735765f7d2b54c199827df142bcb409b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9734a35b-525c-4342-be48-d3aa33224079),volume_type_id=9734a35b-525c-4342-be48-d3aa33224079)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb8011d-c489-4d7b-972a-a6fe975be3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb8011d-c489-4d7b-972a-a6fe975be3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d9d923-580b-4429-96b4-ff0e4615772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d9d923-580b-4429-96b4-ff0e4615772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37bd6b5-6680-445b-9bcb-683ed1eb8622', 'volume_name': 'volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0175023-2c89-451b-a434-4d6f04a9d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0175023-2c89-451b-a434-4d6f04a9d211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcea163f-67ae-4eaf-bda8-260f96195e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:54:58 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Volume d37bd6b5-6680-445b-9bcb-683ed1eb8622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622', 'volume_size': 1} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=676b3573-488f-4deb-a37e-13f529117a37,created_at=2026-07-10T03:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987049234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=676b3573-488f-4deb-a37e-13f529117a37,host='devstack@QuobyteHD#QuobyteHD',id=d37bd6b5-6680-445b-9bcb-683ed1eb8622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2b95f9df24ddaad6e9c48af379eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:54:58Z,use_quota=True,user_id='735765f7d2b54c199827df142bcb409b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9734a35b-525c-4342-be48-d3aa33224079),volume_type_id=9734a35b-525c-4342-be48-d3aa33224079)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Creating volume d37bd6b5-6680-445b-9bcb-683ed1eb8622 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:54:58 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:58 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 1073741824 Jul 10 05:54:58 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:54:58 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 1073741824" returned: 0 in 0.911s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:54:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:54:59 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 Jul 10 05:54:59 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:00 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622" returned: 0 in 1.048s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcea163f-67ae-4eaf-bda8-260f96195e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2443f2-2bc8-4517-b3a9-b1015b2bb789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:00 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Volume volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 (d37bd6b5-6680-445b-9bcb-683ed1eb8622): created successfully Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2443f2-2bc8-4517-b3a9-b1015b2bb789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Flow 'volume_create_manager' (05efb884-8614-4125-980e-b0641e48c680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:00 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-467ea61f-7f87-4401-9833-e2769bdf93d0 tempest-GroupsTest-989375876 None] Created volume successfully. Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Acquiring lock "cinder-quobyte-d37bd6b5-6680-445b-9bcb-683ed1eb8622" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Lock "cinder-quobyte-d37bd6b5-6680-445b-9bcb-683ed1eb8622" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[24db43b6-9dcb-41c8-915f-fcac8f2604bb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:01 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 Jul 10 05:55:01 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (087a07ca-e457-4b2e-b351-196673f269c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65afc3df-baf4-43ee-bef2-dce5c552a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65afc3df-baf4-43ee-bef2-dce5c552a86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108586027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:02Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e501d49f-37d7-469f-bdca-affa8c9a29e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e501d49f-37d7-469f-bdca-affa8c9a29e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41039bd-1ff0-497c-8860-3ea5e0f7dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41039bd-1ff0-497c-8860-3ea5e0f7dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd', 'volume_name': 'volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6bc77d-7de9-417f-88ff-48ca45d29b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6bc77d-7de9-417f-88ff-48ca45d29b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7efa336-90ba-435e-81bc-0e02942261aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Volume fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd', 'volume_size': 1} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-108586027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:02Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Creating volume fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:01 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:01 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd 1073741824 Jul 10 05:55:01 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:02 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622" returned: 0 in 0.929s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:02 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622 Jul 10 05:55:02 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-b4700b1a-a302-42f8-b5e6-008c6d7d0a08 req-e91737f4-30b0-4e78-8941-06ead7a84503 tempest-TestStampPattern-1403787926 None] Terminate volume connection completed successfully. Jul 10 05:55:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-b4700b1a-a302-42f8-b5e6-008c6d7d0a08 req-e91737f4-30b0-4e78-8941-06ead7a84503 tempest-TestStampPattern-1403787926 None] Deleting attachment ec775de8-f08f-44fa-bdbb-468ea04f0348. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:55:03 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd 1073741824" returned: 0 in 1.421s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:03 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd Jul 10 05:55:03 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:03 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d37bd6b5-6680-445b-9bcb-683ed1eb8622" returned: 0 in 1.227s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Lock "cinder-quobyte-d37bd6b5-6680-445b-9bcb-683ed1eb8622" released by "delete_volume" :: held 2.217s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Created reservations ['ce8e8bd8-7ab3-499e-8c87-34806d0c8ee1'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:03 devstack cinder-volume[87449]: WARNING cinder.quota [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1182477991 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1182477991, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:55:03 devstack cinder-volume[87449]: WARNING cinder.quota [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1182477991 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1182477991, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Created reservations ['3e6ba5f2-702e-426e-a6fc-3d35d18f8c3d', 'a925ad22-a71e-4f7b-a947-8d0f887af1aa', 'ca3c8983-7cbd-4a06-b036-1cc47348d871', '5850713a-c2b1-4e54-b917-05dd62fb120b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:03 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:03 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Created reservations ['43d3b1ae-4f07-4444-baef-ab91bfd06e7f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:04 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:04 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:04 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" returned: 0 in 1.315s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] <== create_volume: return (2818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:04 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.950s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9719263c-9ca8-4c72-a26f-13932312599c tempest-GroupsTest-989375876 None] Delete group completed successfully. Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7efa336-90ba-435e-81bc-0e02942261aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b738f3e8-6b88-4215-adc5-3be19b6ca87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:04 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Volume volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd (fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd): created successfully Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b738f3e8-6b88-4215-adc5-3be19b6ca87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (087a07ca-e457-4b2e-b351-196673f269c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8836ac79-3050-4181-8e22-1d8ce4f2c9f5 tempest-VolumesActionsTest-350100986 None] Created volume successfully. Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Creating offline snapshot 740c801b-f29c-4ae1-9043-fc99914ebf91 of volume 6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f67c37-ca75-4cd2-b7ed-4f30de6469c2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:05 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:55:05 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:05 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e92c538a-0c9a-4f9c-a9b8-62af02e5ffcb tempest-VolumesActionsTest-350100986 None] Acquiring lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" by "attach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.834s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ba797166-a1af-4705-b1b6-45d3370cd8f2 tempest-GroupsTest-989375876 None] Delete group completed successfully. Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e92c538a-0c9a-4f9c-a9b8-62af02e5ffcb tempest-VolumesActionsTest-350100986 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" acquired by "attach_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e92c538a-0c9a-4f9c-a9b8-62af02e5ffcb tempest-VolumesActionsTest-350100986 None] Attaching volume fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd to instance 2b388d7b-eb0a-4518-ab3c-36278b63934f at mountpoint /dev/vdb on host None. Jul 10 05:55:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e92c538a-0c9a-4f9c-a9b8-62af02e5ffcb tempest-VolumesActionsTest-350100986 None] Attach volume completed successfully. Jul 10 05:55:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e92c538a-0c9a-4f9c-a9b8-62af02e5ffcb tempest-VolumesActionsTest-350100986 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" released by "attach_volume" :: held 0.140s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:06 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 1.179s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:06 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 1G Jul 10 05:55:06 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3a803321-cb35-40c4-9822-2fab2364761a tempest-GroupsTest-989375876 None] Group tempest-GroupsTest-Group-1850763219: creating Jul 10 05:55:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3a803321-cb35-40c4-9822-2fab2364761a tempest-GroupsTest-989375876 None] Group tempest-GroupsTest-Group-1850763219: created successfully Jul 10 05:55:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3a803321-cb35-40c4-9822-2fab2364761a tempest-GroupsTest-989375876 None] Create group completed successfully. Jul 10 05:55:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-58129e04-43d8-4cbe-a97e-53c150b67abe tempest-VolumesActionsTest-1614767492 None] Terminate volume connection completed successfully. Jul 10 05:55:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58129e04-43d8-4cbe-a97e-53c150b67abe tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-detach_volume" by "detach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58129e04-43d8-4cbe-a97e-53c150b67abe tempest-VolumesActionsTest-1614767492 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-58129e04-43d8-4cbe-a97e-53c150b67abe tempest-VolumesActionsTest-1614767492 None] Detaching volume fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd from instance 2b388d7b-eb0a-4518-ab3c-36278b63934f. Jul 10 05:55:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-58129e04-43d8-4cbe-a97e-53c150b67abe tempest-VolumesActionsTest-1614767492 None] Detach volume completed successfully. Jul 10 05:55:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58129e04-43d8-4cbe-a97e-53c150b67abe tempest-VolumesActionsTest-1614767492 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:07 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 1G" returned: 0 in 0.960s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6903c92f-58b6-4154-a714-6e53e40889b8 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:07 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6903c92f-58b6-4154-a714-6e53e40889b8 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 Jul 10 05:55:07 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e19a2ce9-a2c1-4869-9820-91d0afa1bcd0 tempest-VolumesActionsTest-350100986 None] Acquiring lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-detach_volume" by "detach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e19a2ce9-a2c1-4869-9820-91d0afa1bcd0 tempest-VolumesActionsTest-350100986 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e19a2ce9-a2c1-4869-9820-91d0afa1bcd0 tempest-VolumesActionsTest-350100986 None] Volume detach called, but volume not attached. Jul 10 05:55:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e19a2ce9-a2c1-4869-9820-91d0afa1bcd0 tempest-VolumesActionsTest-350100986 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Flow 'volume_create_manager' (b63e9e2c-8759-4a90-9a20-d1b7db77af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53d32a3-41ed-4c1e-83a9-5b9943d79e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53d32a3-41ed-4c1e-83a9-5b9943d79e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896101680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f3035c5-ba4f-488e-bc1d-fa280c76f14b,host='devstack@QuobyteHD#QuobyteHD',id=67de138b-1f41-4b97-8156-72fc535119f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2b95f9df24ddaad6e9c48af379eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:08Z,use_quota=True,user_id='735765f7d2b54c199827df142bcb409b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb5306d-348e-4a0f-8751-68bb7ca4fb09),volume_type_id=4cb5306d-348e-4a0f-8751-68bb7ca4fb09)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a559dbc5-4c99-45d2-aa77-fef9e69499d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a559dbc5-4c99-45d2-aa77-fef9e69499d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:08 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aed3a4e-3c6d-46a2-93ef-5c49d4096b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aed3a4e-3c6d-46a2-93ef-5c49d4096b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67de138b-1f41-4b97-8156-72fc535119f9', 'volume_name': 'volume-67de138b-1f41-4b97-8156-72fc535119f9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82977b3-a36d-40a6-9a66-97be790a1a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82977b3-a36d-40a6-9a66-97be790a1a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163be51b-51b2-4c77-adc1-c10b82cff8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:08 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Volume 67de138b-1f41-4b97-8156-72fc535119f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67de138b-1f41-4b97-8156-72fc535119f9', 'volume_size': 1} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Acquiring lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6903c92f-58b6-4154-a714-6e53e40889b8 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91" returned: 0 in 1.712s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:08 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 is being set with open permissions: ugo+rw Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:09 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 Jul 10 05:55:09 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Acquiring lock "cinder-quobyte-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Lock "cinder-quobyte-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69131da-4294-4c01-abac-f8a1e3390e91]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:09 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd Jul 10 05:55:09 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:10 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91" returned: 0 in 1.167s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:10 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info Jul 10 05:55:10 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:10 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" returned: 0 in 1.077s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:10 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd Jul 10 05:55:10 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:10 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info" returned: 0 in 0.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:10 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info is being set with open permissions: ugo+rw Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:10 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info Jul 10 05:55:10 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:10 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" returned: 0 in 0.725s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Lock "cinder-quobyte-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd" released by "delete_volume" :: held 1.901s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Created reservations ['8870b233-72c9-4342-9a95-b8bdfe32f6c7', 'bcbcb174-c6cd-4923-9bb8-c6272f681e36', 'c1067949-babd-427d-843b-4f7a6e27dc4e', 'e7d0408d-910e-4baf-b236-b972bc44cb2d'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:11 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:11 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:11 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.info" returned: 0 in 0.979s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.877s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.991s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f3035c5-ba4f-488e-bc1d-fa280c76f14b,created_at=2026-07-10T03:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896101680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f3035c5-ba4f-488e-bc1d-fa280c76f14b,host='devstack@QuobyteHD#QuobyteHD',id=67de138b-1f41-4b97-8156-72fc535119f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2b95f9df24ddaad6e9c48af379eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:08Z,use_quota=True,user_id='735765f7d2b54c199827df142bcb409b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb5306d-348e-4a0f-8751-68bb7ca4fb09),volume_type_id=4cb5306d-348e-4a0f-8751-68bb7ca4fb09)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Creating volume 67de138b-1f41-4b97-8156-72fc535119f9 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:11 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:11 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 1073741824 Jul 10 05:55:11 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-711e5665-2081-4676-8127-74e9e9080fb6 tempest-TestStampPattern-1403787926 None] Create snapshot completed successfully Jul 10 05:55:12 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.068s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:12 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Deleted volume successfully. Jul 10 05:55:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a3ba061-da01-4fd4-8ceb-b754ed43f919 tempest-VolumesActionsTest-350100986 None] Lock "cinder-fbfcffda-706a-4cb1-aee1-b8ae6ae64ffd-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:12 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 1073741824" returned: 0 in 0.946s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:12 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 Jul 10 05:55:12 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:13 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9" returned: 0 in 0.843s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163be51b-51b2-4c77-adc1-c10b82cff8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67de138b-1f41-4b97-8156-72fc535119f9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08188484-87b5-4c36-8383-041e5da04b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:13 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Volume volume-67de138b-1f41-4b97-8156-72fc535119f9 (67de138b-1f41-4b97-8156-72fc535119f9): created successfully Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08188484-87b5-4c36-8383-041e5da04b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Flow 'volume_create_manager' (b63e9e2c-8759-4a90-9a20-d1b7db77af6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:13 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cca42877-3b20-4ee1-8faa-e10d2b4e3774 tempest-GroupsTest-989375876 None] Created volume successfully. Jul 10 05:55:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Acquiring lock "cinder-da3ca318-a4aa-4148-a405-ee23a3600639-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "cinder-da3ca318-a4aa-4148-a405-ee23a3600639-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Acquiring lock "cinder-quobyte-da3ca318-a4aa-4148-a405-ee23a3600639" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "cinder-quobyte-da3ca318-a4aa-4148-a405-ee23a3600639" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:14 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff22fd-0a3b-49e4-913d-66c97a8b00b1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:15 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 Jul 10 05:55:15 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Flow 'volume_create_manager' (251874b2-854a-4f89-91e8-103975efce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9d74d4-c558-44fd-8aa6-d09cbf423739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:15 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9d74d4-c558-44fd-8aa6-d09cbf423739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-516465783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f3035c5-ba4f-488e-bc1d-fa280c76f14b,host='devstack@QuobyteHD#QuobyteHD',id=5d26b99a-ac9a-4629-9e96-0399f80d3669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2b95f9df24ddaad6e9c48af379eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:16Z,use_quota=True,user_id='735765f7d2b54c199827df142bcb409b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb5306d-348e-4a0f-8751-68bb7ca4fb09),volume_type_id=4cb5306d-348e-4a0f-8751-68bb7ca4fb09)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60861db-afa4-47a2-9c57-7c793cdcefdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60861db-afa4-47a2-9c57-7c793cdcefdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4066e38c-37df-448a-bbac-d80081f9357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4066e38c-37df-448a-bbac-d80081f9357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d26b99a-ac9a-4629-9e96-0399f80d3669', 'volume_name': 'volume-5d26b99a-ac9a-4629-9e96-0399f80d3669', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc2072c-5f41-4ffa-9f7b-1b6b515250b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc2072c-5f41-4ffa-9f7b-1b6b515250b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f34bb96-310a-4793-8ae3-ea63fd38b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Volume 5d26b99a-ac9a-4629-9e96-0399f80d3669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d26b99a-ac9a-4629-9e96-0399f80d3669', 'volume_size': 1} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f3035c5-ba4f-488e-bc1d-fa280c76f14b,created_at=2026-07-10T03:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-516465783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f3035c5-ba4f-488e-bc1d-fa280c76f14b,host='devstack@QuobyteHD#QuobyteHD',id=5d26b99a-ac9a-4629-9e96-0399f80d3669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d2b95f9df24ddaad6e9c48af379eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:16Z,use_quota=True,user_id='735765f7d2b54c199827df142bcb409b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb5306d-348e-4a0f-8751-68bb7ca4fb09),volume_type_id=4cb5306d-348e-4a0f-8751-68bb7ca4fb09)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Creating volume 5d26b99a-ac9a-4629-9e96-0399f80d3669 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:15 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639" returned: 0 in 0.956s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:15 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 1073741824 Jul 10 05:55:15 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:15 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639 Jul 10 05:55:15 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:16 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-da3ca318-a4aa-4148-a405-ee23a3600639" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "cinder-quobyte-da3ca318-a4aa-4148-a405-ee23a3600639" released by "delete_volume" :: held 1.711s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Created reservations ['372535b8-f432-41c1-becd-1e8a6a4fd374', '37086daf-f86c-4305-a954-300461c22783', '0164b415-25a0-4843-bab3-d1b579edcc47', 'b5515deb-3770-4025-a323-0067a63a6997'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:16 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:16 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:16 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 1073741824" returned: 0 in 0.908s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:16 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 Jul 10 05:55:16 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:17 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.731s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Deleted volume successfully. Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=81,cinder:SELECT=82,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0e7fef55-211c-4eb2-9a71-a0d32193ec63 tempest-AttachVolumeShelveTestJSON-1063625589 None] Lock "cinder-da3ca318-a4aa-4148-a405-ee23a3600639-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:17 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669" returned: 0 in 0.747s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:INSERT=20,cinder:SELECT=89,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f34bb96-310a-4793-8ae3-ea63fd38b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d26b99a-ac9a-4629-9e96-0399f80d3669', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba5bfc9-c2ce-4d12-8158-6d689d0fe02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:17 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Volume volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 (5d26b99a-ac9a-4629-9e96-0399f80d3669): created successfully Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba5bfc9-c2ce-4d12-8158-6d689d0fe02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Flow 'volume_create_manager' (251874b2-854a-4f89-91e8-103975efce13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e2059aba-cdc2-48ec-97ba-00c7228d3d3d tempest-GroupsTest-989375876 None] Created volume successfully. Jul 10 05:55:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6cb303ab-9a5c-489d-a80c-9453e60e30f4 tempest-GroupsTest-989375876 None] Update group completed successfully. Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (bd1e0c30-2a5f-45a3-808f-b22c36fcc7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaa365-cf34-449d-b504-95f759e58e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaa365-cf34-449d-b504-95f759e58e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347620356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:19Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d581fdd2-17ea-4e0a-a57d-c8745deded6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d581fdd2-17ea-4e0a-a57d-c8745deded6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fb1709-e8a6-4e30-b595-985ca4dd2e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fb1709-e8a6-4e30-b595-985ca4dd2e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6', 'volume_name': 'volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f701737e-b1d3-4d45-9f6c-6ef8538a669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f701737e-b1d3-4d45-9f6c-6ef8538a669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415e142d-9451-4b60-b9f8-5df1ef025fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Volume a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6', 'volume_size': 1} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347620356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:19Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Creating volume a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:18 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:18 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 1073741824 Jul 10 05:55:18 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:19 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 1073741824" returned: 0 in 0.960s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:19 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 Jul 10 05:55:19 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f13139c0-60e5-4bd9-9b94-475147d51e4c tempest-GroupsTest-989375876 None] Update group completed successfully. Jul 10 05:55:20 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6" returned: 0 in 0.818s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415e142d-9451-4b60-b9f8-5df1ef025fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dbdee1-085f-4f86-afc4-a00844ec20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Volume volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 (a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6): created successfully Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dbdee1-085f-4f86-afc4-a00844ec20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (bd1e0c30-2a5f-45a3-808f-b22c36fcc7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:20 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-270d1746-931a-49b7-9d6c-e5595695cb1a tempest-VolumesActionsTest-350100986 None] Created volume successfully. Jul 10 05:55:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Acquiring lock "cinder-quobyte-5d26b99a-ac9a-4629-9e96-0399f80d3669" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Lock "cinder-quobyte-5d26b99a-ac9a-4629-9e96-0399f80d3669" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:21 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb9efb-ec0c-466d-9590-adde1697b0fe]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:21 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 Jul 10 05:55:21 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Lock "cinder-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-quobyte-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[922980e9-0f85-4687-821d-c116bbc5959c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:22 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 Jul 10 05:55:22 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:22 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669" returned: 0 in 1.033s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:22 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669 Jul 10 05:55:22 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:23 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6" returned: 0 in 0.925s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:23 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6 Jul 10 05:55:23 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:23 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5d26b99a-ac9a-4629-9e96-0399f80d3669" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Lock "cinder-quobyte-5d26b99a-ac9a-4629-9e96-0399f80d3669" released by "delete_volume" :: held 1.831s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Acquiring lock "cinder-quobyte-67de138b-1f41-4b97-8156-72fc535119f9" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Lock "cinder-quobyte-67de138b-1f41-4b97-8156-72fc535119f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31e53b9-cebe-4aa0-93db-bd24bfc3bcc0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:23 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 Jul 10 05:55:23 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:24 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6" returned: 0 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6" released by "delete_volume" :: held 1.816s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Flow 'volume_create_manager' (13e8371c-10eb-4fec-9cb4-9a7a8864db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12977986-9120-43ef-842d-a651e0979fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12977986-9120-43ef-842d-a651e0979fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1940840227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53be75b-0cc4-4254-8e65-005266327988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='814f2e929dda4f2eabd66a93c2ecdc14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=740c801b-f29c-4ae1-9043-fc99914ebf91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:24Z,use_quota=True,user_id='44a7fc2b062940e793c5948cb715628b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246714f5-0789-498f-8829-a3713b2a7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246714f5-0789-498f-8829-a3713b2a7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082f3c19-8b92-484f-922e-04ddb9bf5c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082f3c19-8b92-484f-922e-04ddb9bf5c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a53be75b-0cc4-4254-8e65-005266327988', 'volume_name': 'volume-a53be75b-0cc4-4254-8e65-005266327988', 'volume_size': 1, 'snapshot_id': '740c801b-f29c-4ae1-9043-fc99914ebf91'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f970f7b4-1e29-4c0e-bb3c-9622246723d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f970f7b4-1e29-4c0e-bb3c-9622246723d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c06e743-199f-4362-aeea-90723dc717ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Volume a53be75b-0cc4-4254-8e65-005266327988: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a53be75b-0cc4-4254-8e65-005266327988', 'volume_size': 1, 'snapshot_id': '740c801b-f29c-4ae1-9043-fc99914ebf91'} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Created reservations ['9ad2e7b1-b14a-411a-9e90-d9723616c002', '3f2e1483-7bef-4997-86a8-b8f42b77ffe5', '1085c6f3-7307-4125-b216-02b747ee53fd', '332ba11f-4608-4c5d-b6ac-ad32b9a86c13'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-quobyte-740c801b-f29c-4ae1-9043-fc99914ebf91-a53be75b-0cc4-4254-8e65-005266327988" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-740c801b-f29c-4ae1-9043-fc99914ebf91-a53be75b-0cc4-4254-8e65-005266327988" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Creating volume a53be75b-0cc4-4254-8e65-005266327988 from snapshot 740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-quobyte-a53be75b-0cc4-4254-8e65-005266327988" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-a53be75b-0cc4-4254-8e65-005266327988" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] snapshot: 740c801b-f29c-4ae1-9043-fc99914ebf91, volume: a53be75b-0cc4-4254-8e65-005266327988, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[041559a1-16fc-4ea1-8c7e-0e02d762a2e8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:24 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:24 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:24 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9" returned: 0 in 1.060s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:24 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 Jul 10 05:55:24 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:24 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9 Jul 10 05:55:24 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:25 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Flow 'volume_create_manager' (c33f77eb-c482-43b8-b5d9-85670843fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659277e5-3e55-485c-845f-32d30b97063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:25 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.995s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-67de138b-1f41-4b97-8156-72fc535119f9" returned: 0 in 0.882s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Deleted volume successfully. Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659277e5-3e55-485c-845f-32d30b97063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-712616943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2733fa-d06a-4180-9390-3c8c017fb425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e0acccbccf47f88469969b90bae644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:25Z,use_quota=True,user_id='d001cf0568074395a8e99f0e4e65eb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17f42c7-c604-412b-8a6b-885982e2fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17f42c7-c604-412b-8a6b-885982e2fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c72ab7-7d4f-433c-aeba-6774d44bc8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c72ab7-7d4f-433c-aeba-6774d44bc8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2733fa-d06a-4180-9390-3c8c017fb425', 'volume_name': 'volume-ae2733fa-d06a-4180-9390-3c8c017fb425', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e21be0-408a-4eb7-920a-f6b93c4f39e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e21be0-408a-4eb7-920a-f6b93c4f39e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ae08c0-b5b5-4f70-96e4-b4645ac090d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:25 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Volume ae2733fa-d06a-4180-9390-3c8c017fb425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2733fa-d06a-4180-9390-3c8c017fb425', 'volume_size': 1} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Lock "cinder-quobyte-67de138b-1f41-4b97-8156-72fc535119f9" released by "delete_volume" :: held 2.056s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3cfeb612-4110-454d-a148-c5fb4dec18ec tempest-VolumesActionsTest-1614767492 None] Lock "cinder-a86ee40b-7a61-4b83-a971-ae2dd2cbe8f6-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Created reservations ['fb7f77b1-7148-4c93-8e9d-550269dd3891'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:25 devstack cinder-volume[87449]: WARNING cinder.quota [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1935986668 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1935986668, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:55:25 devstack cinder-volume[87449]: WARNING cinder.quota [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1935986668 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1935986668, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Created reservations ['ff83f3e7-8484-4833-97a5-c8fcc1941007', '50d491d7-176e-4be2-9484-87b1d797f752', '97bf3d56-0a79-4d9a-a5f2-6365bd04e623', '5f9f06d7-cdf4-4b16-813c-428d0a571e8c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:25 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91" returned: 0 in 1.307s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6903c92f-58b6-4154-a714-6e53e40889b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc836727-f177-474e-844e-57ac4eb4e7f5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:25 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:55:25 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Created reservations ['861cbbd6-37ad-4bc0-826b-b8717df39668', '1db1df47-5828-4803-93ab-53b01aaeb188', 'c6561231-64d9-4476-8357-d334f310da73', 'a2a67fba-1ba6-4aaf-9ce6-d8baaf8c2ef0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:26 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:26 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (18dd7b6d-f401-4e46-8cdf-9bb2f024ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff184ae-7612-445c-9347-7ef6cf06f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff184ae-7612-445c-9347-7ef6cf06f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1232320933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0054d867-2b78-46b5-90be-0fe704206b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:26Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a7d4df-793f-4abd-88b2-87b5d8f3bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a7d4df-793f-4abd-88b2-87b5d8f3bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b78404-6a07-4de8-8f62-605bbd3fcb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b78404-6a07-4de8-8f62-605bbd3fcb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0054d867-2b78-46b5-90be-0fe704206b95', 'volume_name': 'volume-0054d867-2b78-46b5-90be-0fe704206b95', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d8b171-8fb8-46e3-ad8c-37b20fb85c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d8b171-8fb8-46e3-ad8c-37b20fb85c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc578d0-d5c8-4c56-bc23-4d34766df6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Volume 0054d867-2b78-46b5-90be-0fe704206b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0054d867-2b78-46b5-90be-0fe704206b95', 'volume_size': 1} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:26 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 0.970s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:26 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 Jul 10 05:55:26 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:26 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.719s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:26 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cb3121f4-e517-4005-8622-e1df627294df tempest-GroupsTest-989375876 None] Delete group completed successfully. Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:28 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:28 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:30 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.309s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:55:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:55:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:55:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988" returned: 0 in 6.273s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:33 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6ef79b-a02e-4910-9463-166bdb439aa7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:33 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:55:33 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:34 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 1.608s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:34 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:55:34 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Converted 1024.00 MB image at 163.22 MB/s Jul 10 05:55:34 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 is being set with open permissions: ugo+rw Jul 10 05:55:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:34 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 Jul 10 05:55:34 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:35 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988" returned: 0 in 0.818s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-a53be75b-0cc4-4254-8e65-005266327988" released by "_copy_volume_from_snapshot" :: held 11.124s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-740c801b-f29c-4ae1-9043-fc99914ebf91-a53be75b-0cc4-4254-8e65-005266327988" released by "_create_volume_from_snapshot" :: held 11.196s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.219s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.960s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-712616943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2733fa-d06a-4180-9390-3c8c017fb425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e0acccbccf47f88469969b90bae644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:25Z,use_quota=True,user_id='d001cf0568074395a8e99f0e4e65eb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Creating volume ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:35 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:35 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 1073741824 Jul 10 05:55:35 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c06e743-199f-4362-aeea-90723dc717ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53be75b-0cc4-4254-8e65-005266327988', 'volume_size': 1, 'snapshot_id': '740c801b-f29c-4ae1-9043-fc99914ebf91'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e38c45-a6cc-42f1-972b-a85fa9d443b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Volume volume-a53be75b-0cc4-4254-8e65-005266327988 (a53be75b-0cc4-4254-8e65-005266327988): created successfully Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e38c45-a6cc-42f1-972b-a85fa9d443b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Flow 'volume_create_manager' (13e8371c-10eb-4fec-9cb4-9a7a8864db04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e5c86bf4-5839-4e35-a266-50580d87833f tempest-TestStampPattern-1403787926 None] Created volume successfully. Jul 10 05:55:36 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 1073741824" returned: 0 in 1.016s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:36 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 Jul 10 05:55:36 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:37 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425" returned: 0 in 0.714s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.900s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1232320933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0054d867-2b78-46b5-90be-0fe704206b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:26Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Creating volume 0054d867-2b78-46b5-90be-0fe704206b95 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:37 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ae08c0-b5b5-4f70-96e4-b4645ac090d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2733fa-d06a-4180-9390-3c8c017fb425', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:37 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 1073741824 Jul 10 05:55:37 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9d611b-3d40-49ad-b690-b44abb261627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Volume volume-ae2733fa-d06a-4180-9390-3c8c017fb425 (ae2733fa-d06a-4180-9390-3c8c017fb425): created successfully Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9d611b-3d40-49ad-b690-b44abb261627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Flow 'volume_create_manager' (c33f77eb-c482-43b8-b5d9-85670843fb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-726e5d09-d861-437e-96bf-54558ea3b8f6 req-bc051d0a-d91c-4478-ae46-73a96926da6a tempest-VolumesSnapshotsTestJSON-1408576877 None] Created volume successfully. Jul 10 05:55:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:38 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 1073741824" returned: 0 in 1.001s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:38 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 Jul 10 05:55:38 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:39 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95" returned: 0 in 0.991s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.198s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Creating offline snapshot 7477af63-6e16-4618-9e05-08ad7df4722a of volume ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc578d0-d5c8-4c56-bc23-4d34766df6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0054d867-2b78-46b5-90be-0fe704206b95', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95704778-bafd-4113-bf30-32fe220b2469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee44fcc-e87e-4efb-95b1-a0cff69c4b79]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Volume volume-0054d867-2b78-46b5-90be-0fe704206b95 (0054d867-2b78-46b5-90be-0fe704206b95): created successfully Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95704778-bafd-4113-bf30-32fe220b2469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (18dd7b6d-f401-4e46-8cdf-9bb2f024ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6246e9d5-71ab-427e-97f6-ffa717fb1737 tempest-VolumesActionsTest-350100986 None] Created volume successfully. Jul 10 05:55:39 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 Jul 10 05:55:39 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-0054d867-2b78-46b5-90be-0fe704206b95-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-0054d867-2b78-46b5-90be-0fe704206b95-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-quobyte-0054d867-2b78-46b5-90be-0fe704206b95" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-0054d867-2b78-46b5-90be-0fe704206b95" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:40 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b499e2-4639-4b09-8246-9e5c44fb0242]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:40 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 Jul 10 05:55:40 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:40 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425" returned: 0 in 0.924s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:40 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a 1G Jul 10 05:55:40 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:41 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95" returned: 0 in 1.173s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:41 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95 Jul 10 05:55:41 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:41 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a 1G" returned: 0 in 1.135s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2733fa-d06a-4180-9390-3c8c017fb425 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:41 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2733fa-d06a-4180-9390-3c8c017fb425 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a Jul 10 05:55:41 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:42 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0054d867-2b78-46b5-90be-0fe704206b95" returned: 0 in 0.846s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-0054d867-2b78-46b5-90be-0fe704206b95" released by "delete_volume" :: held 2.077s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Created reservations ['edfd2c47-e77c-4ce1-aa88-9bb830779460', 'a1144968-c9a0-462c-8320-91fa01421f01', 'fb111def-4a7d-4637-ad87-048e601cc575', '8b459746-148a-4ecc-815e-1b4fd7433f05'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:42 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:42 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:42 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2733fa-d06a-4180-9390-3c8c017fb425 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a" returned: 0 in 1.031s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:42 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a is being set with open permissions: ugo+rw Jul 10 05:55:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:42 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a Jul 10 05:55:42 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:43 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.761s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:43 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Deleted volume successfully. Jul 10 05:55:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ef68dec2-97e8-4277-9b60-95b20c570f25 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-0054d867-2b78-46b5-90be-0fe704206b95-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:43 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a" returned: 0 in 0.827s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:43 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info Jul 10 05:55:43 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (cb1f8c22-684e-4ee5-a931-385fff2552c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a860d2d1-13d0-4c34-a77f-d1137f21bd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a860d2d1-13d0-4c34-a77f-d1137f21bd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-59950453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a48813-83a1-4eb2-9d22-2ec3216bb094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:44Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b04985-84fb-4819-a929-62de2fb854b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b04985-84fb-4819-a929-62de2fb854b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16a90d9-d222-486b-a9e8-f71aa4284ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16a90d9-d222-486b-a9e8-f71aa4284ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a48813-83a1-4eb2-9d22-2ec3216bb094', 'volume_name': 'volume-06a48813-83a1-4eb2-9d22-2ec3216bb094', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda17a95-7aaf-48b2-ab29-04078eff15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda17a95-7aaf-48b2-ab29-04078eff15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b11ae1-b356-4bf6-95e2-6e16d9110202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Volume 06a48813-83a1-4eb2-9d22-2ec3216bb094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a48813-83a1-4eb2-9d22-2ec3216bb094', 'volume_size': 1} Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:44 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info" returned: 0 in 1.085s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:44 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info is being set with open permissions: ugo+rw Jul 10 05:55:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:44 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info Jul 10 05:55:44 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:45 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.info" returned: 0 in 0.780s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.999s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-59950453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a48813-83a1-4eb2-9d22-2ec3216bb094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:44Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Creating volume 06a48813-83a1-4eb2-9d22-2ec3216bb094 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:45 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-8d0ee053-5c09-46cf-93d3-f1fed241d9ec req-419b0a66-4117-4e28-86af-c8c1b7a4f316 tempest-VolumesSnapshotsTestJSON-1408576877 None] Create snapshot completed successfully Jul 10 05:55:45 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 1073741824 Jul 10 05:55:45 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "cinder-7477af63-6e16-4618-9e05-08ad7df4722a-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-7477af63-6e16-4618-9e05-08ad7df4722a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "cinder-quobyte-ae2733fa-d06a-4180-9390-3c8c017fb425" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-quobyte-ae2733fa-d06a-4180-9390-3c8c017fb425" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "cinder-quobyte-7477af63-6e16-4618-9e05-08ad7df4722a" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-quobyte-7477af63-6e16-4618-9e05-08ad7df4722a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Deleting offline snapshot 7477af63-6e16-4618-9e05-08ad7df4722a of volume ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] snapshot_file for this snap is: volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df4f1c-9635-41fa-a20b-209287d7e56b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:46 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a Jul 10 05:55:46 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:46 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 1073741824" returned: 0 in 1.525s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:47 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 Jul 10 05:55:47 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:47 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a" returned: 0 in 1.545s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2733fa-d06a-4180-9390-3c8c017fb425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18f16e9-b079-4d66-a4fd-5356b61ba526]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:47 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 Jul 10 05:55:47 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:47 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094" returned: 0 in 0.970s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.589s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b11ae1-b356-4bf6-95e2-6e16d9110202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a48813-83a1-4eb2-9d22-2ec3216bb094', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a17f4fc-2485-4fbc-bd94-65fb02f272d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:48 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Volume volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 (06a48813-83a1-4eb2-9d22-2ec3216bb094): created successfully Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a17f4fc-2485-4fbc-bd94-65fb02f272d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (cb1f8c22-684e-4ee5-a931-385fff2552c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6666169e-984d-4ffc-a1a4-8b8739bb5b70 tempest-VolumesActionsTest-350100986 None] Created volume successfully. Jul 10 05:55:48 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425" returned: 0 in 1.119s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:48 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a Jul 10 05:55:48 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-06a48813-83a1-4eb2-9d22-2ec3216bb094-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-06a48813-83a1-4eb2-9d22-2ec3216bb094-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-quobyte-06a48813-83a1-4eb2-9d22-2ec3216bb094" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-06a48813-83a1-4eb2-9d22-2ec3216bb094" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c466401b-7156-406e-87df-fda80517c3e8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:49 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 Jul 10 05:55:49 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:49 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a" returned: 0 in 1.257s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:49 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a Jul 10 05:55:49 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:50 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094" returned: 0 in 1.105s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:50 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094 Jul 10 05:55:50 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:50 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425.7477af63-6e16-4618-9e05-08ad7df4722a" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-quobyte-7477af63-6e16-4618-9e05-08ad7df4722a" released by "_delete_snapshot" :: held 4.905s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-quobyte-ae2733fa-d06a-4180-9390-3c8c017fb425" released by "delete_snapshot" :: held 4.959s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG cinder.quota [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Created reservations ['3246438c-c9b4-414d-bd85-125b3f6ded85', 'da425df4-6792-492a-b59b-d0c7ac320f1e', 'daee252b-3b4b-469c-953a-f86e4a5a9c38', 'b561d76f-1de3-4700-9214-115674069e65'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:50 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-06a48813-83a1-4eb2-9d22-2ec3216bb094" returned: 0 in 0.837s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-06a48813-83a1-4eb2-9d22-2ec3216bb094" released by "delete_volume" :: held 2.006s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Delete snapshot completed successfully. Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-025d93ae-8715-48da-978a-1e8fe3ddf7ae req-7a19bec0-22e3-4a21-a9fa-ea0eb520008c tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-7477af63-6e16-4618-9e05-08ad7df4722a-delete_snapshot" released by "delete_snapshot" :: held 5.233s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Created reservations ['8115d08b-c6a5-4caf-8f8f-4c187610b0ca', 'b6c534ee-4fd7-4406-8d1e-05dd8226d036', '5de271f3-b951-41e8-b5cf-3ef8eeb91085', 'faa9ed30-de20-4223-b7f1-2a67a8a0f0e2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:51 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:51 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "cinder-ae2733fa-d06a-4180-9390-3c8c017fb425-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-ae2733fa-d06a-4180-9390-3c8c017fb425-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "cinder-quobyte-ae2733fa-d06a-4180-9390-3c8c017fb425" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-quobyte-ae2733fa-d06a-4180-9390-3c8c017fb425" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[390aeee0-2422-48cb-8f3d-d11181a73048]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:51 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 Jul 10 05:55:51 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:51 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.838s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Deleted volume successfully. Jul 10 05:55:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-648024e6-2aaa-4568-957c-f38769922c74 tempest-VolumesActionsTest-1614767492 None] Lock "cinder-06a48813-83a1-4eb2-9d22-2ec3216bb094-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:52 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:52 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (93c34a1a-418a-4949-bd0f-440158d3cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74794a1-609d-4f40-bae2-fba16e81779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425" returned: 0 in 1.248s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74794a1-609d-4f40-bae2-fba16e81779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1842898267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2609a119-61f0-4c07-aedd-18842d73de7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:53Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbe6dd4-9cb2-475e-93b6-c1ab49ee1c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:53 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425 Jul 10 05:55:53 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbe6dd4-9cb2-475e-93b6-c1ab49ee1c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91339f0c-db26-4208-8696-e72f28ab89e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91339f0c-db26-4208-8696-e72f28ab89e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2609a119-61f0-4c07-aedd-18842d73de7f', 'volume_name': 'volume-2609a119-61f0-4c07-aedd-18842d73de7f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c6b33c-999b-4319-afa3-7293ac22e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c6b33c-999b-4319-afa3-7293ac22e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8282a5f8-e695-4b60-8f4c-840426bdff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:53 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Volume 2609a119-61f0-4c07-aedd-18842d73de7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2609a119-61f0-4c07-aedd-18842d73de7f', 'volume_size': 1} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1842898267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2609a119-61f0-4c07-aedd-18842d73de7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:53Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Creating volume 2609a119-61f0-4c07-aedd-18842d73de7f {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:53 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:53 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f 1073741824 Jul 10 05:55:53 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:53 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae2733fa-d06a-4180-9390-3c8c017fb425" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-quobyte-ae2733fa-d06a-4180-9390-3c8c017fb425" released by "delete_volume" :: held 2.218s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG cinder.quota [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Created reservations ['319390d0-1d75-45a7-b6b0-2d97ea6fb9e1', '047de2c1-9173-45d0-a3eb-11a88bae8838', '1eea27a2-1daf-478c-86ec-13cf959ce0ae', 'a2559cb7-12d9-4bf1-a3da-5a47bdcbefdb'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:54 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:54 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:54 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f 1073741824" returned: 0 in 1.220s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:54 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f Jul 10 05:55:54 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:54 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.681s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG cinder.manager [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Deleted volume successfully. Jul 10 05:55:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-d824beae-4e0b-4c4d-9357-5203e6534176 req-06c17a26-85e1-429a-a41e-74602359009a tempest-VolumesSnapshotsTestJSON-1408576877 None] Lock "cinder-ae2733fa-d06a-4180-9390-3c8c017fb425-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:55 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f" returned: 0 in 0.785s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8282a5f8-e695-4b60-8f4c-840426bdff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2609a119-61f0-4c07-aedd-18842d73de7f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ac1114-8335-4185-84bf-6b47c08def5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:55 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Volume volume-2609a119-61f0-4c07-aedd-18842d73de7f (2609a119-61f0-4c07-aedd-18842d73de7f): created successfully Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ac1114-8335-4185-84bf-6b47c08def5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (93c34a1a-418a-4949-bd0f-440158d3cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0ca88cc9-dee8-4fab-bde7-addf834d55e6 tempest-VolumesActionsTest-350100986 None] Created volume successfully. Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Flow 'volume_create_manager' (8427c49b-ac90-4140-89f7-1ec1e1b996cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a807e1-ef97-49ab-ab82-ce9d612dacf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a807e1-ef97-49ab-ab82-ce9d612dacf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-502357061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b503f5b8-f629-4e39-9f9d-5fe520bb060b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aaa454a8c08463a9c8831c4c69ff441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:56Z,use_quota=True,user_id='d884527c665840dfbf180ab5f78df7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bdc1af-dbe4-4e06-ab2f-d1839071e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bdc1af-dbe4-4e06-ab2f-d1839071e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b2c530-927e-4564-acff-c3b0ea4ca8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b2c530-927e-4564-acff-c3b0ea4ca8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b503f5b8-f629-4e39-9f9d-5fe520bb060b', 'volume_name': 'volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0076584-3d56-4003-b44c-872c0d16b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0076584-3d56-4003-b44c-872c0d16b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92e9a41-6a0f-48a2-a960-5404af91d78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:55 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Volume b503f5b8-f629-4e39-9f9d-5fe520bb060b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b', 'volume_size': 1} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-502357061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b503f5b8-f629-4e39-9f9d-5fe520bb060b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aaa454a8c08463a9c8831c4c69ff441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:56Z,use_quota=True,user_id='d884527c665840dfbf180ab5f78df7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Creating volume b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:55:55 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:55:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:55 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b 1073741824 Jul 10 05:55:55 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-2609a119-61f0-4c07-aedd-18842d73de7f-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Lock "cinder-2609a119-61f0-4c07-aedd-18842d73de7f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Acquiring lock "cinder-quobyte-2609a119-61f0-4c07-aedd-18842d73de7f" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-2609a119-61f0-4c07-aedd-18842d73de7f" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2063db9-dd80-4696-b4f6-f4db0cf40be3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:56 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f Jul 10 05:55:56 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:56 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b 1073741824" returned: 0 in 1.006s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:56 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b Jul 10 05:55:56 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:57 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f" returned: 0 in 0.833s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:57 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f Jul 10 05:55:57 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:57 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b" returned: 0 in 0.686s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92e9a41-6a0f-48a2-a960-5404af91d78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dfadc0-02b7-4380-8afa-b7e951c95020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:57 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Volume volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b (b503f5b8-f629-4e39-9f9d-5fe520bb060b): created successfully Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45dfadc0-02b7-4380-8afa-b7e951c95020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Flow 'volume_create_manager' (8427c49b-ac90-4140-89f7-1ec1e1b996cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8f0478fe-4f7b-4e36-9212-8edb4fcd95ea tempest-SnapshotMetadataTestJSON-71600207 None] Created volume successfully. Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Creating offline snapshot fe502055-c9bb-44ae-a161-2e4748a34db8 of volume b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b941b6e-e79d-40ec-befe-94d8e3b3311a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:58 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2609a119-61f0-4c07-aedd-18842d73de7f" returned: 0 in 0.792s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Lock "cinder-quobyte-2609a119-61f0-4c07-aedd-18842d73de7f" released by "delete_volume" :: held 1.675s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:58 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b Jul 10 05:55:58 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Created reservations ['0c0bb3b4-2832-43f3-8223-48b2991bc45a', '0b2dcde1-802f-4528-9ce5-9a7a64e8a123', 'f2e1cd2f-f4f1-4f03-9ecc-7666aca414cf', '2b8dbcbc-6bd4-49fb-a301-2f4d877696b7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:55:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:58 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:55:58 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:58 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:59 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 1G Jul 10 05:55:59 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:55:59 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:55:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Deleted volume successfully. Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9d5bff63-cd58-4e7b-a612-90ca5a592a7f tempest-VolumesActionsTest-1614767492 None] Lock "cinder-2609a119-61f0-4c07-aedd-18842d73de7f-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (3c2676fe-56bd-4c01-995d-efec233e06aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84664d05-3b25-4653-b434-e1e71020e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84664d05-3b25-4653-b434-e1e71020e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723626742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4186a15d-096f-4133-a2a1-7676c4c71e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:59Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cebc6669-fd0b-4dbf-9c47-77a45be8bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cebc6669-fd0b-4dbf-9c47-77a45be8bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36f51c4-2ca5-4ecd-83d4-36429d6ed6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36f51c4-2ca5-4ecd-83d4-36429d6ed6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4186a15d-096f-4133-a2a1-7676c4c71e9b', 'volume_name': 'volume-4186a15d-096f-4133-a2a1-7676c4c71e9b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917d88d9-bfe6-4cfb-98af-aee8218a33c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917d88d9-bfe6-4cfb-98af-aee8218a33c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1399f66a-46dd-41ec-8324-a296e673e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:55:59 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Volume 4186a15d-096f-4133-a2a1-7676c4c71e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4186a15d-096f-4133-a2a1-7676c4c71e9b', 'volume_size': 1} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:55:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d6eb78d2-7c39-49de-bd82-bb822916efab tempest-GroupsV314Test-735044096 None] Group tempest-GroupsV314Test-Group-390389044: creating Jul 10 05:55:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d6eb78d2-7c39-49de-bd82-bb822916efab tempest-GroupsV314Test-735044096 None] Group tempest-GroupsV314Test-Group-390389044: created successfully Jul 10 05:55:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d6eb78d2-7c39-49de-bd82-bb822916efab tempest-GroupsV314Test-735044096 None] Create group completed successfully. Jul 10 05:55:59 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 1G" returned: 0 in 0.857s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:55:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:55:59 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 Jul 10 05:55:59 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:00 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8" returned: 0 in 0.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:00 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 is being set with open permissions: ugo+rw Jul 10 05:56:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:00 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 Jul 10 05:56:00 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Flow 'volume_create_manager' (b5b409ab-3d06-41a2-9688-3c246002ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e17570d-2e82-48ed-8b8f-b7bc9713e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e17570d-2e82-48ed-8b8f-b7bc9713e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915559248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3875c245-cd86-4f03-8e08-9a3c0aee2e59,host='devstack@QuobyteHD#QuobyteHD',id=d77a078d-4a26-4446-95c0-6a1ebccd2d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d069c22d50164eb28caa7ffe5e9649ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:01Z,use_quota=True,user_id='90a716ae3a5c45eab69309a58f627cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da545873-f8b2-4631-b16a-c67f25243f61),volume_type_id=da545873-f8b2-4631-b16a-c67f25243f61)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944b4f7d-d411-486c-b432-50a0f84a96d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944b4f7d-d411-486c-b432-50a0f84a96d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d912d0ec-5f71-42dd-8f47-3f6c91c4172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d912d0ec-5f71-42dd-8f47-3f6c91c4172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77a078d-4a26-4446-95c0-6a1ebccd2d75', 'volume_name': 'volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:01 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ecabad-9681-4e7d-80dc-04d5da209ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ecabad-9681-4e7d-80dc-04d5da209ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543c9a13-eb4e-4949-b78d-f0a631f8fac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Volume d77a078d-4a26-4446-95c0-6a1ebccd2d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75', 'volume_size': 1} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8" returned: 0 in 0.672s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:01 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info Jul 10 05:56:01 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:01 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info" returned: 0 in 0.664s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:01 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info is being set with open permissions: ugo+rw Jul 10 05:56:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:01 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info Jul 10 05:56:01 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:02 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.info" returned: 0 in 0.624s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.501s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.081s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723626742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4186a15d-096f-4133-a2a1-7676c4c71e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af28616f384ff7a0b5a97297bb3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:55:59Z,use_quota=True,user_id='b13c98ea56944b5b94b9dc968d5dedb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Creating volume 4186a15d-096f-4133-a2a1-7676c4c71e9b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:02 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:02 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b 1073741824 Jul 10 05:56:02 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cb86f937-6aea-4ec6-b0da-175ea9dbed7a tempest-SnapshotMetadataTestJSON-71600207 None] Create snapshot completed successfully Jul 10 05:56:03 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b 1073741824" returned: 0 in 0.822s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:03 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b Jul 10 05:56:03 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "cinder-fe502055-c9bb-44ae-a161-2e4748a34db8-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-fe502055-c9bb-44ae-a161-2e4748a34db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "cinder-quobyte-b503f5b8-f629-4e39-9f9d-5fe520bb060b" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-quobyte-b503f5b8-f629-4e39-9f9d-5fe520bb060b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "cinder-quobyte-fe502055-c9bb-44ae-a161-2e4748a34db8" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-quobyte-fe502055-c9bb-44ae-a161-2e4748a34db8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Deleting offline snapshot fe502055-c9bb-44ae-a161-2e4748a34db8 of volume b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] snapshot_file for this snap is: volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5580331e-a5d3-4851-992b-58d079aa2b71]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:04 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b" returned: 0 in 0.698s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.910s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3875c245-cd86-4f03-8e08-9a3c0aee2e59,created_at=2026-07-10T03:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915559248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3875c245-cd86-4f03-8e08-9a3c0aee2e59,host='devstack@QuobyteHD#QuobyteHD',id=d77a078d-4a26-4446-95c0-6a1ebccd2d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d069c22d50164eb28caa7ffe5e9649ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:01Z,use_quota=True,user_id='90a716ae3a5c45eab69309a58f627cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da545873-f8b2-4631-b16a-c67f25243f61),volume_type_id=da545873-f8b2-4631-b16a-c67f25243f61)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Creating volume d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:04 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:04 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 1073741824 Jul 10 05:56:04 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1399f66a-46dd-41ec-8324-a296e673e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4186a15d-096f-4133-a2a1-7676c4c71e9b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd7b594-9778-4143-aba8-7c8aa25b4057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:04 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Volume volume-4186a15d-096f-4133-a2a1-7676c4c71e9b (4186a15d-096f-4133-a2a1-7676c4c71e9b): created successfully Jul 10 05:56:04 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 Jul 10 05:56:04 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd7b594-9778-4143-aba8-7c8aa25b4057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Flow 'volume_create_manager' (3c2676fe-56bd-4c01-995d-efec233e06aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-08c64c33-2a7a-406e-8280-3dd49104e963 tempest-VolumesActionsTest-350100986 None] Created volume successfully. Jul 10 05:56:04 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8" returned: 0 in 0.846s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c558e55-781e-4c78-8396-f5637caadf5f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:05 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 1073741824" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:05 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b Jul 10 05:56:05 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:05 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:05 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Acquiring lock "cinder-4186a15d-096f-4133-a2a1-7676c4c71e9b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Lock "cinder-4186a15d-096f-4133-a2a1-7676c4c71e9b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Acquiring lock "cinder-quobyte-4186a15d-096f-4133-a2a1-7676c4c71e9b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Lock "cinder-quobyte-4186a15d-096f-4133-a2a1-7676c4c71e9b" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b90c8a-7400-4cce-8460-96cbf3e9625d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:05 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b Jul 10 05:56:05 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:05 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b" returned: 0 in 0.795s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:05 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 Jul 10 05:56:05 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:05 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 0.736s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543c9a13-eb4e-4949-b78d-f0a631f8fac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a751ef27-06a8-4d6c-b62c-1e185c08fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Volume volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 (d77a078d-4a26-4446-95c0-6a1ebccd2d75): created successfully Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a751ef27-06a8-4d6c-b62c-1e185c08fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Flow 'volume_create_manager' (b5b409ab-3d06-41a2-9688-3c246002ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b74c2746-b3fc-4dfa-a0be-6f9cca39a420 tempest-GroupsV314Test-735044096 None] Created volume successfully. Jul 10 05:56:06 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b" returned: 0 in 0.832s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:06 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b Jul 10 05:56:06 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:06 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8" returned: 0 in 0.864s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:06 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8 Jul 10 05:56:06 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:06 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4186a15d-096f-4133-a2a1-7676c4c71e9b" returned: 0 in 0.731s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Lock "cinder-quobyte-4186a15d-096f-4133-a2a1-7676c4c71e9b" released by "delete_volume" :: held 1.618s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Created reservations ['34ebbbc8-a008-4900-8f57-15afb97b958b', '64a95a4e-d7b5-45ba-bc8b-da8f8697a279', 'cb490bb7-7836-4891-9ae0-1c881a343d30', '62a00262-8b75-4efc-98b7-8e5573c29629'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:07 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:07 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:07 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b.fe502055-c9bb-44ae-a161-2e4748a34db8" returned: 0 in 0.709s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-quobyte-fe502055-c9bb-44ae-a161-2e4748a34db8" released by "_delete_snapshot" :: held 3.354s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-quobyte-b503f5b8-f629-4e39-9f9d-5fe520bb060b" released by "delete_snapshot" :: held 3.377s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Created reservations ['74d01b20-b642-4240-928c-152a56324efe', 'dc390ce0-f38c-4417-b85a-98bebd445dba', '77394251-bfeb-460d-b29f-4e1d348f0ff6', '809dc1ec-6f3c-4a2f-b05b-ba711647914a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Delete snapshot completed successfully. Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d62ec7-f4d7-415a-89f5-a95c23e1f506 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-fe502055-c9bb-44ae-a161-2e4748a34db8-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:07 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Deleted volume successfully. Jul 10 05:56:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a24a4126-1312-4c85-9d80-6aa91f64ee66 tempest-VolumesActionsTest-350100986 None] Lock "cinder-4186a15d-096f-4133-a2a1-7676c4c71e9b-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:08 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Cloning volume d77a078d-4a26-4446-95c0-6a1ebccd2d75 to volume 039afc8a-40ee-4426-88fe-41ba3d8fa0aa Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Creating offline snapshot 45d77034-f00a-4805-b8bd-2319a68956bf of volume d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c906a57-8c88-4c72-afe2-4f8e6691fbe1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "cinder-b503f5b8-f629-4e39-9f9d-5fe520bb060b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-b503f5b8-f629-4e39-9f9d-5fe520bb060b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "cinder-quobyte-b503f5b8-f629-4e39-9f9d-5fe520bb060b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:08 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:08 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-quobyte-b503f5b8-f629-4e39-9f9d-5fe520bb060b" acquired by "delete_volume" :: waited 0.040s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2355f8-2f81-4785-b661-75779953955d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:08 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b Jul 10 05:56:08 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:09 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 1.083s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:09 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf 1G Jul 10 05:56:09 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:09 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b" returned: 0 in 1.012s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:09 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b Jul 10 05:56:09 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:10 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf 1G" returned: 0 in 0.927s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:10 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf Jul 10 05:56:10 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:10 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b503f5b8-f629-4e39-9f9d-5fe520bb060b" returned: 0 in 0.873s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-quobyte-b503f5b8-f629-4e39-9f9d-5fe520bb060b" released by "delete_volume" :: held 1.985s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Created reservations ['1764a6b4-fd38-4ebd-802e-acebf9792f5e', '003c1efb-df09-41eb-83f4-224da8c2abe7', 'f6038cd5-cd1e-4466-ab14-959a233f7298', '5630095d-984c-4001-9bf6-e520a79cfdd7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:10 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:10 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:11 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf" returned: 0 in 0.814s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:11 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:56:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:11 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf Jul 10 05:56:11 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:11 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.936s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:11 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Deleted volume successfully. Jul 10 05:56:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dbf51ec6-7147-48a7-af35-9593b2c52d27 tempest-SnapshotMetadataTestJSON-71600207 None] Lock "cinder-b503f5b8-f629-4e39-9f9d-5fe520bb060b-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:12 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf" returned: 0 in 0.865s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:12 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info Jul 10 05:56:12 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:12 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info" returned: 0 in 0.747s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:12 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:56:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:12 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info Jul 10 05:56:12 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:13 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.info" returned: 0 in 0.784s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Acquiring lock "cinder-quobyte-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] snapshot: 45d77034-f00a-4805-b8bd-2319a68956bf, volume: 039afc8a-40ee-4426-88fe-41ba3d8fa0aa, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[441971d0-f85e-4ff8-a385-3d27d5359fbb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:13 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf Jul 10 05:56:13 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:14 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:56:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:56:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:56:14 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ef80e-f650-40e7-99f7-6973002927a0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:14 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:14 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:15 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 0.936s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:15 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:56:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:15 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa Jul 10 05:56:15 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Flow 'volume_create_manager' (3f774236-3c45-4564-ac0b-c6a9bc8ea722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd1086-273f-4961-9d68-7691535fbbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd1086-273f-4961-9d68-7691535fbbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-773399915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef15bca7-a4b8-4047-b6fa-d147ba1b94d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add0836259b64bf1905ba860bf7623ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:16Z,use_quota=True,user_id='09e29449e1d144009f5fd81d31fecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4f24e8-a133-4188-a392-b171291da6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4f24e8-a133-4188-a392-b171291da6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fa09ee-8c52-4598-a636-1b0942afd639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fa09ee-8c52-4598-a636-1b0942afd639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef15bca7-a4b8-4047-b6fa-d147ba1b94d0', 'volume_name': 'volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b580c42-8fd8-4782-864c-1a1170f38a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b580c42-8fd8-4782-864c-1a1170f38a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d11af19-2c0c-4007-87ae-b530480a67ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:16 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Volume ef15bca7-a4b8-4047-b6fa-d147ba1b94d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0', 'volume_size': 1} Jul 10 05:56:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:20 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" returned: 0 in 5.495s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:20 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba3bc55-41b2-4b36-8ed3-9d77c756a30a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:21 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:21 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:21 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 0.967s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:21 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:56:21 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Converted 1024.00 MB image at 186.30 MB/s Jul 10 05:56:21 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa is being set with open permissions: ugo+rw: NotImplementedError Jul 10 05:56:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:21 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa Jul 10 05:56:21 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:22 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" released by "_copy_volume_from_snapshot" :: held 8.980s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=106,cinder:DELETE=12,cinder:SELECT=97,cinder:INSERT=33 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Acquiring lock "cinder-quobyte-45d77034-f00a-4805-b8bd-2319a68956bf" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-45d77034-f00a-4805-b8bd-2319a68956bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Deleting offline snapshot 45d77034-f00a-4805-b8bd-2319a68956bf of volume d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] snapshot_file for this snap is: volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2ecd2-c0cd-4b66-963b-4b42b67a6190]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:22 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf Jul 10 05:56:22 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=99,cinder:UPDATE=134,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Flow 'volume_create_manager' (596f9e50-7197-49c5-a386-47f0755d87c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3776f0b2-ffe8-4ec9-b2df-821c1a314ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3776f0b2-ffe8-4ec9-b2df-821c1a314ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1647662697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5276a6-7659-479c-8bd3-1f6e2e44d169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce71b053e94fbaab5031e97d5d6e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:23Z,use_quota=True,user_id='63c8217618cf4836a1e54b281d0201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005d0fcc-f445-474e-b772-8d40bbe379d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005d0fcc-f445-474e-b772-8d40bbe379d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7e5397-836f-47bb-916e-27caf57e4b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7e5397-836f-47bb-916e-27caf57e4b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac5276a6-7659-479c-8bd3-1f6e2e44d169', 'volume_name': 'volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925758ab-d50b-476a-9f7f-6c668e1984f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925758ab-d50b-476a-9f7f-6c668e1984f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e974cd66-cf8b-4d37-94d6-c5a9514bd1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:23 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Volume ac5276a6-7659-479c-8bd3-1f6e2e44d169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169', 'volume_size': 1} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:23 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf" returned: 0 in 0.808s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9899dbc-a1f9-44d4-a066-d0990632443c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:23 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:23 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:24 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 0.740s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:24 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf Jul 10 05:56:24 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:25 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf" returned: 0 in 0.707s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:25 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf Jul 10 05:56:25 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:25 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75.45d77034-f00a-4805-b8bd-2319a68956bf" returned: 0 in 0.628s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-45d77034-f00a-4805-b8bd-2319a68956bf" released by "_delete_snapshot" :: held 2.972s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.457s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.610s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df4754-f5cb-42b5-8000-7c53650c706d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e9bdffef-3494-4072-94e2-f31eb5908174 tempest-GroupsV314Test-735044096 None] Create group from source-group-3875c245-cd86-4f03-8e08-9a3c0aee2e59 completed successfully. Jul 10 05:56:25 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 Jul 10 05:56:25 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Acquiring lock "cinder-quobyte-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f94bd-00a5-436d-83e4-63950ed740a5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:26 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988" returned: 0 in 0.823s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.227s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-773399915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef15bca7-a4b8-4047-b6fa-d147ba1b94d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add0836259b64bf1905ba860bf7623ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:16Z,use_quota=True,user_id='09e29449e1d144009f5fd81d31fecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Creating volume ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:26 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:26 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 1073741824 Jul 10 05:56:26 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-a53be75b-0cc4-4254-8e65-005266327988', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0c7ca58-3564-4290-b8e0-3dd5706c252d', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 05:56:26 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa Jul 10 05:56:26 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-69f64f1d-4778-4d5c-81c5-3af7ba2811a9 req-783c569c-b2e5-4cb4-8365-6708c82c8638 tempest-TestStampPattern-1403787926 None] attachment_update completed successfully. Jul 10 05:56:27 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" returned: 0 in 0.841s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:27 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa Jul 10 05:56:27 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:27 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 1073741824" returned: 0 in 0.894s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:27 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 Jul 10 05:56:27 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:28 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" returned: 0 in 0.725s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-039afc8a-40ee-4426-88fe-41ba3d8fa0aa" released by "delete_volume" :: held 1.633s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:28 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0" returned: 0 in 0.644s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.940s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1647662697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5276a6-7659-479c-8bd3-1f6e2e44d169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce71b053e94fbaab5031e97d5d6e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:23Z,use_quota=True,user_id='63c8217618cf4836a1e54b281d0201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Creating volume ac5276a6-7659-479c-8bd3-1f6e2e44d169 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:28 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:28 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 1073741824 Jul 10 05:56:28 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d11af19-2c0c-4007-87ae-b530480a67ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1469ff-858c-4388-ab97-79e963696aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:28 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Volume volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 (ef15bca7-a4b8-4047-b6fa-d147ba1b94d0): created successfully Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1469ff-858c-4388-ab97-79e963696aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Flow 'volume_create_manager' (3f774236-3c45-4564-ac0b-c6a9bc8ea722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4c5e3753-f682-47a7-81eb-8f876447a17e tempest-VolumesTransfersV355Test-1670053194 None] Created volume successfully. Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Created reservations ['bdf71b9f-8cb6-4c11-b6bb-0bf65ed4c480'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:28 devstack cinder-volume[87449]: WARNING cinder.quota [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-247905342 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-247905342, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:56:28 devstack cinder-volume[87449]: WARNING cinder.quota [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-247905342 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-247905342, it is now deprecated. Please use the default quota class for default quota. Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Created reservations ['f0f5f65d-cb30-434d-ae51-0849afdd55a1', '75992a16-8e48-4222-a0f1-cf00c44bdc6a', 'ef015b23-47d7-40f9-83a0-b619a8720075', '6c7a417f-cd0b-4185-9b33-1a5232ab2aa3'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:28 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:28 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:28 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:28 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Acquiring lock "cinder-quobyte-d77a078d-4a26-4446-95c0-6a1ebccd2d75" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-d77a078d-4a26-4446-95c0-6a1ebccd2d75" acquired by "delete_volume" :: waited 0.033s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ef4dda-bc33-4a66-a01e-e55632498d73]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:29 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.923s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:29 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-31d972bf-7d35-4ef1-8e41-27af68e6062a tempest-GroupsV314Test-735044096 None] Delete group completed successfully. Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 1073741824" returned: 0 in 1.176s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:29 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:29 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:29 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 Jul 10 05:56:29 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e010a462-57f7-4f1f-9ded-5bace42f1ef6 tempest-VolumesTransfersV355Test-1955567950 None] Transfer volume completed successfully. Jul 10 05:56:29 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.855s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:56:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:56:30 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169" returned: 0 in 0.731s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e974cd66-cf8b-4d37-94d6-c5a9514bd1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e413cb0e-a8eb-4d19-800d-ece5d252fa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:30 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 0.912s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:30 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Volume volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 (ac5276a6-7659-479c-8bd3-1f6e2e44d169): created successfully Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e413cb0e-a8eb-4d19-800d-ece5d252fa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Flow 'volume_create_manager' (596f9e50-7197-49c5-a386-47f0755d87c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:30 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75 Jul 10 05:56:30 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3bbd6995-c749-422c-8573-3ed86de414d2 tempest-VolumesListAdminTestJSON-991705747 None] Created volume successfully. Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Acquiring lock "cinder-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Acquiring lock "cinder-quobyte-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-quobyte-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a430eef-1347-4e43-83d7-4685ff815547]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:30 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 Jul 10 05:56:30 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:30 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d77a078d-4a26-4446-95c0-6a1ebccd2d75" returned: 0 in 0.716s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Lock "cinder-quobyte-d77a078d-4a26-4446-95c0-6a1ebccd2d75" released by "delete_volume" :: held 1.732s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Created reservations ['25163225-b5a1-4103-8a5d-7c0f9a783a98'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Created reservations ['ae137fd0-6e3b-4b2d-b3b0-67fccd63c28c', '6cd3fdba-0b26-4c7c-9e77-099e75994f09', '16d66bab-e376-40a5-aafb-09ae11408587', '864ada6d-3599-4e2b-99a4-c85d45f6abc0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:31 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:31 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Flow 'volume_create_manager' (4dbd7ba7-5264-462e-8d7f-1c310edfd2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3220a27-a020-48ee-8741-7529a1547829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3220a27-a020-48ee-8741-7529a1547829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004670737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9422eba1-1b6a-47ba-824f-bacc7713abbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce71b053e94fbaab5031e97d5d6e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:31Z,use_quota=True,user_id='63c8217618cf4836a1e54b281d0201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf67077-7337-4b82-9e5e-eed2db5d5d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf67077-7337-4b82-9e5e-eed2db5d5d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1528dc-9846-4562-9ceb-f0457b6083e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1528dc-9846-4562-9ceb-f0457b6083e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9422eba1-1b6a-47ba-824f-bacc7713abbe', 'volume_name': 'volume-9422eba1-1b6a-47ba-824f-bacc7713abbe', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2b4c41-c7c9-4b84-8b4f-dcdc2ce8d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2b4c41-c7c9-4b84-8b4f-dcdc2ce8d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e19111-f8a8-4989-993c-9a3217bf10b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:31 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Volume 9422eba1-1b6a-47ba-824f-bacc7713abbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9422eba1-1b6a-47ba-824f-bacc7713abbe', 'volume_size': 1} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004670737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9422eba1-1b6a-47ba-824f-bacc7713abbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce71b053e94fbaab5031e97d5d6e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:31Z,use_quota=True,user_id='63c8217618cf4836a1e54b281d0201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Creating volume 9422eba1-1b6a-47ba-824f-bacc7713abbe {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:31 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:31 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe 1073741824 Jul 10 05:56:31 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:31 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0" returned: 0 in 0.869s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:31 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0 Jul 10 05:56:31 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:32 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.874s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-77f0b165-1c4a-4ac3-8f6e-8c2f5a390966 tempest-GroupsV314Test-735044096 None] Delete group completed successfully. Jul 10 05:56:32 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0" returned: 0 in 0.877s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-quobyte-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0" released by "delete_volume" :: held 1.816s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Created reservations ['cc99e4a7-1418-458f-b569-8e4e56f0c7f5', '6880f322-77c3-4624-99f7-88861a3b4615', 'f697cb2c-b049-4ff2-a644-e13ff1d79413', '4b32e775-f549-4ad5-a840-7d4a9716027e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:32 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe 1073741824" returned: 0 in 1.143s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:32 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:32 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:32 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:32 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:33 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe" returned: 0 in 0.967s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e19111-f8a8-4989-993c-9a3217bf10b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9422eba1-1b6a-47ba-824f-bacc7713abbe', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343f47e-388a-4234-90fa-63162cb8ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:33 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Volume volume-9422eba1-1b6a-47ba-824f-bacc7713abbe (9422eba1-1b6a-47ba-824f-bacc7713abbe): created successfully Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343f47e-388a-4234-90fa-63162cb8ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Flow 'volume_create_manager' (4dbd7ba7-5264-462e-8d7f-1c310edfd2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:33 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Flow 'volume_create_manager' (357235e4-1c9e-443a-bb31-401cc3fc525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbad7957-e5e2-47f9-b700-f599c2f412b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cc4dd89e-07ae-4c3b-b39c-ed8d51727647 tempest-VolumesListAdminTestJSON-991705747 None] Created volume successfully. Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.068s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbad7957-e5e2-47f9-b700-f599c2f412b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-436748378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33292597-cc3b-4fb8-99ce-0105c4770b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add0836259b64bf1905ba860bf7623ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:34Z,use_quota=True,user_id='09e29449e1d144009f5fd81d31fecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6766c8b5-1c38-4b2b-9484-de8993cb4716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6766c8b5-1c38-4b2b-9484-de8993cb4716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be5ea89-13d8-431c-8944-d7435c576f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be5ea89-13d8-431c-8944-d7435c576f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33292597-cc3b-4fb8-99ce-0105c4770b8c', 'volume_name': 'volume-33292597-cc3b-4fb8-99ce-0105c4770b8c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b751e3a7-0238-46ee-88af-611a53a95e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b751e3a7-0238-46ee-88af-611a53a95e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65edef51-022d-4ff6-b02a-fa709d101704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:33 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Volume 33292597-cc3b-4fb8-99ce-0105c4770b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33292597-cc3b-4fb8-99ce-0105c4770b8c', 'volume_size': 1} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-436748378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33292597-cc3b-4fb8-99ce-0105c4770b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add0836259b64bf1905ba860bf7623ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:34Z,use_quota=True,user_id='09e29449e1d144009f5fd81d31fecd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Creating volume 33292597-cc3b-4fb8-99ce-0105c4770b8c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:33 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Deleted volume successfully. Jul 10 05:56:33 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c 1073741824 Jul 10 05:56:33 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c841ff32-7fd2-42aa-bc06-21ea9d409106 tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-ef15bca7-a4b8-4047-b6fa-d147ba1b94d0-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-8fa33f10-c7bb-4c94-a147-d1e86579ae5f req-2c8d699b-dd68-46fa-8198-886c1250beca tempest-TestStampPattern-1403787926 None] Terminate volume connection completed successfully. Jul 10 05:56:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-8fa33f10-c7bb-4c94-a147-d1e86579ae5f req-2c8d699b-dd68-46fa-8198-886c1250beca tempest-TestStampPattern-1403787926 None] Deleting attachment c0c7ca58-3564-4290-b8e0-3dd5706c252d. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 05:56:34 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c 1073741824" returned: 0 in 1.010s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:34 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c Jul 10 05:56:34 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Flow 'volume_create_manager' (a2d4c725-07b6-41f8-9784-b274c8e2fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5add2a4-d2b6-406b-9e2b-07a089d06fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5add2a4-d2b6-406b-9e2b-07a089d06fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1034218730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd986eac-b2c2-43cb-a058-771e7865eb31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce71b053e94fbaab5031e97d5d6e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:35Z,use_quota=True,user_id='63c8217618cf4836a1e54b281d0201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e488e1c-f997-487e-a911-37b8c037cbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e488e1c-f997-487e-a911-37b8c037cbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2612be9-96da-48ee-ac19-6e70cc5a7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2612be9-96da-48ee-ac19-6e70cc5a7611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd986eac-b2c2-43cb-a058-771e7865eb31', 'volume_name': 'volume-fd986eac-b2c2-43cb-a058-771e7865eb31', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d786dfe-be58-430f-a4f0-eea76a1644b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d786dfe-be58-430f-a4f0-eea76a1644b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6f605-3b19-4bd9-86b7-cee11fc2940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Volume fd986eac-b2c2-43cb-a058-771e7865eb31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd986eac-b2c2-43cb-a058-771e7865eb31', 'volume_size': 1} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:35 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.249s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1034218730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd986eac-b2c2-43cb-a058-771e7865eb31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce71b053e94fbaab5031e97d5d6e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:35Z,use_quota=True,user_id='63c8217618cf4836a1e54b281d0201d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Creating volume fd986eac-b2c2-43cb-a058-771e7865eb31 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:35 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65edef51-022d-4ff6-b02a-fa709d101704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33292597-cc3b-4fb8-99ce-0105c4770b8c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafd2a39-b623-47a1-9097-d228405ea6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:35 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 1073741824 Jul 10 05:56:35 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Volume volume-33292597-cc3b-4fb8-99ce-0105c4770b8c (33292597-cc3b-4fb8-99ce-0105c4770b8c): created successfully Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafd2a39-b623-47a1-9097-d228405ea6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Flow 'volume_create_manager' (357235e4-1c9e-443a-bb31-401cc3fc525c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dd366f28-6e47-4b96-a275-4772f32910c3 tempest-VolumesTransfersV355Test-1670053194 None] Created volume successfully. Jul 10 05:56:36 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 1073741824" returned: 0 in 0.904s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:36 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 Jul 10 05:56:36 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Acquiring lock "cinder-33292597-cc3b-4fb8-99ce-0105c4770b8c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-33292597-cc3b-4fb8-99ce-0105c4770b8c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Acquiring lock "cinder-quobyte-33292597-cc3b-4fb8-99ce-0105c4770b8c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-quobyte-33292597-cc3b-4fb8-99ce-0105c4770b8c" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d7fd0-de33-4dcc-b698-7569e1607487]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:37 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31" returned: 0 in 0.890s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6f605-3b19-4bd9-86b7-cee11fc2940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd986eac-b2c2-43cb-a058-771e7865eb31', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37717afd-e133-4ee1-b345-37d10afc4e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Volume volume-fd986eac-b2c2-43cb-a058-771e7865eb31 (fd986eac-b2c2-43cb-a058-771e7865eb31): created successfully Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37717afd-e133-4ee1-b345-37d10afc4e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Flow 'volume_create_manager' (a2d4c725-07b6-41f8-9784-b274c8e2fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-63e60c18-0843-4416-808b-7b3c87509929 tempest-VolumesListAdminTestJSON-991705747 None] Created volume successfully. Jul 10 05:56:37 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c Jul 10 05:56:37 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9604ffa5-ce10-4927-8f4b-2e28c813d610 tempest-GroupsV320Test-1148383687 None] Group tempest-GroupsV320Test-Group-618932784: creating Jul 10 05:56:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9604ffa5-ce10-4927-8f4b-2e28c813d610 tempest-GroupsV320Test-1148383687 None] Group tempest-GroupsV320Test-Group-618932784: created successfully Jul 10 05:56:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9604ffa5-ce10-4927-8f4b-2e28c813d610 tempest-GroupsV320Test-1148383687 None] Create group completed successfully. Jul 10 05:56:38 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c" returned: 0 in 0.977s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:38 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c Jul 10 05:56:38 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:39 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-33292597-cc3b-4fb8-99ce-0105c4770b8c" returned: 0 in 0.699s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-quobyte-33292597-cc3b-4fb8-99ce-0105c4770b8c" released by "delete_volume" :: held 1.754s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Flow 'volume_create_manager' (dabf1651-d3e6-44c2-89e9-2b6ed9565153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed1b970-84f6-439a-a05f-73022f31303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Created reservations ['99f0ce31-1c3e-4518-b58a-37bcee6fa61a', 'a6ecf439-b1a8-40ad-b4dd-09e5064a5052', '633edae3-278c-438a-b206-9cee5b6e1cb4', 'a45c7ab9-8ff3-4384-bc67-d5bb5044bdd7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed1b970-84f6-439a-a05f-73022f31303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df173bfa-b639-4d4f-b36b-9d22e6981280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d2b4e8c81d4e00ba69b925ef81e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:39Z,use_quota=True,user_id='6bfb6f6ca0d741c2a331c8f0c969ffee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef145e8-09d9-4a33-8a72-659a61785b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef145e8-09d9-4a33-8a72-659a61785b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177818b9-f793-4640-8649-e2a0328cd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177818b9-f793-4640-8649-e2a0328cd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df173bfa-b639-4d4f-b36b-9d22e6981280', 'volume_name': 'volume-df173bfa-b639-4d4f-b36b-9d22e6981280', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a054e2a7-5604-487f-ab2c-8ba8d88004cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a054e2a7-5604-487f-ab2c-8ba8d88004cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b444aa7-7ea8-4f94-a77d-7e7d082b3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Volume df173bfa-b639-4d4f-b36b-9d22e6981280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df173bfa-b639-4d4f-b36b-9d22e6981280', 'volume_size': 1} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df173bfa-b639-4d4f-b36b-9d22e6981280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d2b4e8c81d4e00ba69b925ef81e50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:56:39Z,use_quota=True,user_id='6bfb6f6ca0d741c2a331c8f0c969ffee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Creating volume df173bfa-b639-4d4f-b36b-9d22e6981280 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:56:39 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:39 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 1073741824 Jul 10 05:56:39 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:39 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:39 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Created reservations ['a226182f-1101-4287-b402-c62b205e3fdb'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:40 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:40 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:40 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.070s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Deleted volume successfully. Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-a3d75303-2c78-4335-a002-435984f4931c tempest-VolumesTransfersV355Test-420433571 None] Lock "cinder-33292597-cc3b-4fb8-99ce-0105c4770b8c-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:40 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 1073741824" returned: 0 in 1.635s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:41 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 Jul 10 05:56:41 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:41 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.920s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8e0b5771-143f-4ff5-b991-d2da72e38de6 tempest-GroupsV320Test-1148383687 None] Delete group completed successfully. Jul 10 05:56:41 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b444aa7-7ea8-4f94-a77d-7e7d082b3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df173bfa-b639-4d4f-b36b-9d22e6981280', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6a7f3a-f17b-418f-b2b4-6c3149812439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Volume volume-df173bfa-b639-4d4f-b36b-9d22e6981280 (df173bfa-b639-4d4f-b36b-9d22e6981280): created successfully Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6a7f3a-f17b-418f-b2b4-6c3149812439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Flow 'volume_create_manager' (dabf1651-d3e6-44c2-89e9-2b6ed9565153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3ba32642-e018-4618-8891-317a819e8d0b tempest-VolumesListAdminTestJSON-423830330 None] Created volume successfully. Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Acquiring lock "cinder-df173bfa-b639-4d4f-b36b-9d22e6981280-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Lock "cinder-df173bfa-b639-4d4f-b36b-9d22e6981280-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Acquiring lock "cinder-quobyte-df173bfa-b639-4d4f-b36b-9d22e6981280" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Lock "cinder-quobyte-df173bfa-b639-4d4f-b36b-9d22e6981280" acquired by "delete_volume" :: waited 0.033s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e96f4-2353-46ba-a287-ab3a0a27cae4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "cinder-fd986eac-b2c2-43cb-a058-771e7865eb31-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-fd986eac-b2c2-43cb-a058-771e7865eb31-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:42 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 Jul 10 05:56:42 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "cinder-quobyte-fd986eac-b2c2-43cb-a058-771e7865eb31" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-quobyte-fd986eac-b2c2-43cb-a058-771e7865eb31" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[086393e7-d50f-4956-8b56-f81a0968f4b5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:43 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 Jul 10 05:56:43 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:43 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280" returned: 0 in 1.186s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:44 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280 Jul 10 05:56:44 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:44 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31" returned: 0 in 0.987s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:44 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31 Jul 10 05:56:44 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-a53be75b-0cc4-4254-8e65-005266327988-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Lock "cinder-a53be75b-0cc4-4254-8e65-005266327988-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-quobyte-a53be75b-0cc4-4254-8e65-005266327988" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-a53be75b-0cc4-4254-8e65-005266327988" acquired by "delete_volume" :: waited 0.037s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18127f2c-aeaa-4976-bc49-fd444a228515]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:44 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:44 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-df173bfa-b639-4d4f-b36b-9d22e6981280" returned: 0 in 0.911s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:44 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Lock "cinder-quobyte-df173bfa-b639-4d4f-b36b-9d22e6981280" released by "delete_volume" :: held 2.182s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Created reservations ['4d1291e2-9f40-4cbe-a99c-db717449ea9f', '669804f4-3e90-42a3-a350-dd090ab181de', '073f23a6-20f4-4b0a-ba1d-15b48022d127', 'add50767-aa95-4dbb-9721-52b5fcb3ec60'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:45 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:45 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:45 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-fd986eac-b2c2-43cb-a058-771e7865eb31" returned: 0 in 1.134s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-quobyte-fd986eac-b2c2-43cb-a058-771e7865eb31" released by "delete_volume" :: held 2.208s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Created reservations ['ec043ee1-a7ec-4722-bd66-bf33c774acd5', '13f32c62-9427-4b82-a2f2-4612f5cabae7', '9bc637de-5baa-47fa-9cd7-612ed2185601', '8f1da00d-9561-41ff-ae65-d24757ec1643'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:45 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:45 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:45 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988" returned: 0 in 1.171s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:45 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988 Jul 10 05:56:45 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:46 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.964s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Deleted volume successfully. Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2e5d93aa-7b0a-44ef-8e1c-faa273fe2e15 tempest-VolumesListAdminTestJSON-423830330 None] Lock "cinder-df173bfa-b639-4d4f-b36b-9d22e6981280-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:46 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "cinder-9422eba1-1b6a-47ba-824f-bacc7713abbe-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Deleted volume successfully. Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-64ce10bf-8e88-407b-a1d4-c94f0d27f3bf tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-fd986eac-b2c2-43cb-a058-771e7865eb31-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-9422eba1-1b6a-47ba-824f-bacc7713abbe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "cinder-quobyte-9422eba1-1b6a-47ba-824f-bacc7713abbe" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-quobyte-9422eba1-1b6a-47ba-824f-bacc7713abbe" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fae45be-6a06-45ad-896a-0a76ee39226f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:46 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe Jul 10 05:56:46 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:46 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a53be75b-0cc4-4254-8e65-005266327988" returned: 0 in 1.002s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-a53be75b-0cc4-4254-8e65-005266327988" released by "delete_volume" :: held 2.259s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Created reservations ['6dc96e47-b89a-4c0d-a2e3-3df3c12626de', 'e42aa8b3-980f-43ed-84b3-5238442bb69c', 'a80938b4-fa3a-45ef-9352-a44b58167f53', '314f7478-ee3f-4fa3-af07-85147e0f4f6e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:47 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:47 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:47 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe" returned: 0 in 0.873s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:47 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe Jul 10 05:56:47 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:47 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.922s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:47 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Deleted volume successfully. Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5bdec20-3ef1-475e-92b8-d17c235e7c49 tempest-TestStampPattern-1403787926 None] Lock "cinder-a53be75b-0cc4-4254-8e65-005266327988-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:48 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9422eba1-1b6a-47ba-824f-bacc7713abbe" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-quobyte-9422eba1-1b6a-47ba-824f-bacc7713abbe" released by "delete_volume" :: held 1.671s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Created reservations ['2364c211-8eaf-456e-94c2-761fc50bb3aa', 'd3317491-7e8b-4c46-99ac-59a5d490c4ff', '13995dd1-be80-4375-a7af-389d5788fa89', 'd97165f1-efa1-4408-b3a2-5ff1f4efb708'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:48 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:48 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-740c801b-f29c-4ae1-9043-fc99914ebf91-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Lock "cinder-740c801b-f29c-4ae1-9043-fc99914ebf91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-quobyte-6903c92f-58b6-4154-a714-6e53e40889b8" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-6903c92f-58b6-4154-a714-6e53e40889b8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-quobyte-740c801b-f29c-4ae1-9043-fc99914ebf91" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-740c801b-f29c-4ae1-9043-fc99914ebf91" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Deleting offline snapshot 740c801b-f29c-4ae1-9043-fc99914ebf91 of volume 6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] snapshot_file for this snap is: volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f0db30-ed97-47bd-853b-7135004d4456]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:48 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 Jul 10 05:56:48 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "cinder-ac5276a6-7659-479c-8bd3-1f6e2e44d169-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-ac5276a6-7659-479c-8bd3-1f6e2e44d169-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "cinder-quobyte-ac5276a6-7659-479c-8bd3-1f6e2e44d169" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-quobyte-ac5276a6-7659-479c-8bd3-1f6e2e44d169" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd7dfd-7075-4a19-861d-086d5ad56c6c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:49 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 Jul 10 05:56:49 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:49 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.145s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Deleted volume successfully. Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5287d4a1-d724-4a40-9f5a-e94f1f6c723f tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-9422eba1-1b6a-47ba-824f-bacc7713abbe-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:49 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91" returned: 0 in 1.164s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6903c92f-58b6-4154-a714-6e53e40889b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40ad2f-a59b-449e-9e97-352491f746d7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:56:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:49 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:56:49 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:50 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169" returned: 0 in 1.143s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:50 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169 Jul 10 05:56:50 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:50 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 1.048s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:50 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 Jul 10 05:56:50 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:50 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ac5276a6-7659-479c-8bd3-1f6e2e44d169" returned: 0 in 0.801s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-quobyte-ac5276a6-7659-479c-8bd3-1f6e2e44d169" released by "delete_volume" :: held 1.997s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:50 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Created reservations ['d501eb0a-307d-4a41-9126-250cf03ec242', '3f143e6c-f98d-4364-ae99-816fb7ecc3d0', '31f60251-ab6a-44e9-9012-a701df81b423', '2644acd7-4bed-44d7-8115-7c067eabf267'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:51 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:56:51 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:51 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91" returned: 0 in 0.955s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:56:51 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91 Jul 10 05:56:51 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:56:51 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.784s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:56:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Deleted volume successfully. Jul 10 05:56:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-481d9d22-9303-4c89-bc6c-8c1702f9420a tempest-VolumesListAdminTestJSON-991705747 None] Lock "cinder-ac5276a6-7659-479c-8bd3-1f6e2e44d169-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:52 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 10 05:56:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8.740c801b-f29c-4ae1-9043-fc99914ebf91" returned: 0 in 0.765s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:56:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-740c801b-f29c-4ae1-9043-fc99914ebf91" released by "_delete_snapshot" :: held 4.066s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-6903c92f-58b6-4154-a714-6e53e40889b8" released by "delete_snapshot" :: held 4.096s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:52 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Created reservations ['fe1f5806-fa55-4e90-8bdf-6b29464d338d', 'e23a58a0-8ffd-4f59-b285-fc67f0369dcd', '70e176b8-0195-45ae-b6b2-4e25406fa8b1', '9a079c12-5768-44c0-b5a7-4849e14d91ab'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:56:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Delete snapshot completed successfully. Jul 10 05:56:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d69c5e4-9baf-43dd-a910-8216cb10cace tempest-TestStampPattern-1403787926 None] Lock "cinder-740c801b-f29c-4ae1-9043-fc99914ebf91-delete_snapshot" released by "delete_snapshot" :: held 4.294s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:56:59 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:56:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Flow 'volume_create_manager' (f7adba5f-376d-426d-b596-69ac4bd0214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:56:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0dcef4-b557-4545-96f6-141e8a814ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:56:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0dcef4-b557-4545-96f6-141e8a814ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1877042504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55c911a-a974-41d1-8514-6bd4d9225f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c4973ea5bc45c1b6785df2f752c2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:00Z,use_quota=True,user_id='ddcdfa4edba7451c9babaab1884ab530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:56:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5e1c6c-dd5b-451f-bc50-80c58353cae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5e1c6c-dd5b-451f-bc50-80c58353cae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d9f4f8-d74f-45b8-bc92-5bcac1059d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d9f4f8-d74f-45b8-bc92-5bcac1059d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55c911a-a974-41d1-8514-6bd4d9225f8c', 'volume_name': 'volume-e55c911a-a974-41d1-8514-6bd4d9225f8c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6d400c-d22a-43e1-a4b0-8b167d3c542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6d400c-d22a-43e1-a4b0-8b167d3c542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c36293-9321-4c2f-a4a2-ab6c73759110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Volume e55c911a-a974-41d1-8514-6bd4d9225f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55c911a-a974-41d1-8514-6bd4d9225f8c', 'volume_size': 1} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1877042504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55c911a-a974-41d1-8514-6bd4d9225f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c4973ea5bc45c1b6785df2f752c2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:00Z,use_quota=True,user_id='ddcdfa4edba7451c9babaab1884ab530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Creating volume e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:00 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:00 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c 1073741824 Jul 10 05:57:00 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Flow 'volume_create_manager' (9e6e5b43-c017-4709-9835-71993016a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5041b3d2-fd8d-4c36-87bf-9eff87d63c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5041b3d2-fd8d-4c36-87bf-9eff87d63c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-415153249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2680e53e3034f50b9d2ba50d97f58a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:01Z,use_quota=True,user_id='91342a78746e438da86bfac7339038ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a22a9f-7075-4e8e-9f91-3deeb95e1fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a22a9f-7075-4e8e-9f91-3deeb95e1fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa419355-16eb-4b34-8a8c-070e1e65430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa419355-16eb-4b34-8a8c-070e1e65430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90', 'volume_name': 'volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1510f62-e798-46cb-b83f-044e616070b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1510f62-e798-46cb-b83f-044e616070b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8741bd-b724-4e7d-b187-2bc8c2f4e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:00 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Volume 84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90', 'volume_size': 1} Jul 10 05:57:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:01 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c 1073741824" returned: 0 in 1.103s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:01 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:57:01 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:01 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.689s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-415153249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2680e53e3034f50b9d2ba50d97f58a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:01Z,use_quota=True,user_id='91342a78746e438da86bfac7339038ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Creating volume 84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:01 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:01 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 1073741824 Jul 10 05:57:01 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c36293-9321-4c2f-a4a2-ab6c73759110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55c911a-a974-41d1-8514-6bd4d9225f8c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3be416-13a4-4ea8-a2a7-a60fc99dbb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Volume volume-e55c911a-a974-41d1-8514-6bd4d9225f8c (e55c911a-a974-41d1-8514-6bd4d9225f8c): created successfully Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3be416-13a4-4ea8-a2a7-a60fc99dbb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Flow 'volume_create_manager' (f7adba5f-376d-426d-b596-69ac4bd0214a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2e06d454-f573-454b-8167-4c12846c0665 tempest-VolumesActionsTest-15700650 None] Created volume successfully. Jul 10 05:57:02 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 1073741824" returned: 0 in 0.931s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:02 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 Jul 10 05:57:02 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-6903c92f-58b6-4154-a714-6e53e40889b8-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Lock "cinder-6903c92f-58b6-4154-a714-6e53e40889b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Acquiring lock "cinder-quobyte-6903c92f-58b6-4154-a714-6e53e40889b8" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-6903c92f-58b6-4154-a714-6e53e40889b8" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[264fa077-32c8-4df8-b05a-223c9a69debd]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:03 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90" returned: 0 in 0.793s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8741bd-b724-4e7d-b187-2bc8c2f4e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b49789-0622-4c8e-8be8-2a18e4b37d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:03 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Volume volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 (84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90): created successfully Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b49789-0622-4c8e-8be8-2a18e4b37d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Flow 'volume_create_manager' (9e6e5b43-c017-4709-9835-71993016a83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2dbd288c-7352-4edc-b188-fd75ccce50ee tempest-VolumeQuotasNegativeTestJSON-879284863 None] Created volume successfully. Jul 10 05:57:03 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:57:03 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:04 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 1.047s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:04 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8 Jul 10 05:57:04 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Acquiring lock "cinder-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "cinder-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Acquiring lock "cinder-quobyte-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "cinder-quobyte-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[874f1e8f-d935-4ecc-953d-330d88b830e8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:05 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 Jul 10 05:57:05 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:05 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6903c92f-58b6-4154-a714-6e53e40889b8" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Lock "cinder-quobyte-6903c92f-58b6-4154-a714-6e53e40889b8" released by "delete_volume" :: held 1.895s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Created reservations ['0b34f6de-0593-4177-818f-fac51740a39c', '3df19e87-87ce-448a-973f-49b9af668698', 'f736ee37-3a74-448d-9e74-44f0e60a5068', 'd0d87074-9c8d-4e56-86a1-8ea4236223ff'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:05 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:05 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:06 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90" returned: 0 in 0.994s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:06 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90 Jul 10 05:57:06 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:06 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.963s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:06 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Deleted volume successfully. Jul 10 05:57:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1e67ff85-94e8-40c2-8134-612b821aa4b9 tempest-TestStampPattern-1403787926 None] Lock "cinder-6903c92f-58b6-4154-a714-6e53e40889b8-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:07 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90" returned: 0 in 0.822s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "cinder-quobyte-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90" released by "delete_volume" :: held 1.861s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Created reservations ['36289c88-e931-41b0-be10-3e5472a706dd', '64320341-1a1d-4afa-be29-f4ca10b573ac', '476b386a-ccf6-4a2c-9691-aed9ae8d8ce8', '5e3f316f-791c-49cc-a188-2277eb950c6d'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:07 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:07 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Flow 'volume_create_manager' (79e0bd67-d878-4659-9472-cc13637af810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e19a25c-052e-4504-a5f7-68b3dd4bbec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e19a25c-052e-4504-a5f7-68b3dd4bbec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1826505947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731bd239-e391-4736-97f9-96fef437228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1196866a197640f3a7bb6d06ffee18fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:07Z,use_quota=True,user_id='c4b22505dff94e0283e23530ce7c53dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fe6690-d95c-48d2-be0a-3db27195b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fe6690-d95c-48d2-be0a-3db27195b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaea564-8b95-453e-a7ce-b66cc7e099d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aaea564-8b95-453e-a7ce-b66cc7e099d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731bd239-e391-4736-97f9-96fef437228d', 'volume_name': 'volume-731bd239-e391-4736-97f9-96fef437228d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35bad1b-4cbb-4202-b3c9-d7a0522969e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35bad1b-4cbb-4202-b3c9-d7a0522969e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ff023f-8d4e-41a7-b4b1-bca341041215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:07 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Volume 731bd239-e391-4736-97f9-96fef437228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731bd239-e391-4736-97f9-96fef437228d', 'volume_size': 1} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1826505947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731bd239-e391-4736-97f9-96fef437228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1196866a197640f3a7bb6d06ffee18fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:07Z,use_quota=True,user_id='c4b22505dff94e0283e23530ce7c53dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Creating volume 731bd239-e391-4736-97f9-96fef437228d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:07 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:07 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d 1073741824 Jul 10 05:57:07 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:08 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.958s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:08 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:08 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Deleted volume successfully. Jul 10 05:57:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-90f3ea4d-bc35-4f48-818f-db3630bbb646 tempest-VolumeQuotasNegativeTestJSON-879284863 None] Lock "cinder-84ab86cb-1f6b-4fcd-97d0-351f8cbf1f90-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:08 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d 1073741824" returned: 0 in 0.967s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:08 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d Jul 10 05:57:08 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:09 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d" returned: 0 in 0.761s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ff023f-8d4e-41a7-b4b1-bca341041215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731bd239-e391-4736-97f9-96fef437228d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdea1a27-71ef-4435-ad98-4a7eb416c303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:09 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Volume volume-731bd239-e391-4736-97f9-96fef437228d (731bd239-e391-4736-97f9-96fef437228d): created successfully Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdea1a27-71ef-4435-ad98-4a7eb416c303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:09 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Flow 'volume_create_manager' (79e0bd67-d878-4659-9472-cc13637af810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ae1ec725-fb9f-4bef-a83d-3c46c4e4f77b tempest-VolumesMetadataTest-176145285 None] Created volume successfully. Jul 10 05:57:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Acquiring lock "cinder-731bd239-e391-4736-97f9-96fef437228d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Lock "cinder-731bd239-e391-4736-97f9-96fef437228d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Acquiring lock "cinder-quobyte-731bd239-e391-4736-97f9-96fef437228d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Lock "cinder-quobyte-731bd239-e391-4736-97f9-96fef437228d" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a0031-fe92-479e-ad71-d39f588b707e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:11 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d Jul 10 05:57:11 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:12 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d" returned: 0 in 1.103s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:12 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d Jul 10 05:57:12 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:13 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-731bd239-e391-4736-97f9-96fef437228d" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Lock "cinder-quobyte-731bd239-e391-4736-97f9-96fef437228d" released by "delete_volume" :: held 1.913s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Created reservations ['6d600903-3962-4d39-ab82-1bb465ba4158', '0137eab4-1c78-4ce7-a4b2-831906a6f344', '5b14c0e7-2a27-4a70-85e7-433589ad24c3', '4b1f9294-87c3-4237-a732-d36f7d8eb1ea'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:13 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:13 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:14 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.839s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:14 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Deleted volume successfully. Jul 10 05:57:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8858930f-eda9-446b-b588-18d8df367771 tempest-VolumesMetadataTest-176145285 None] Lock "cinder-731bd239-e391-4736-97f9-96fef437228d-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Flow 'volume_create_manager' (a456864c-434e-4878-b299-0ccf99d9ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc52764-e62c-4692-93f1-1c07ac44eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc52764-e62c-4692-93f1-1c07ac44eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1820070367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790291cf-eedb-4d65-9cbb-5423e2b91360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c795dc23f14961a8e080f1c2f428a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:15Z,use_quota=True,user_id='45023a6c73dc45829e294cdeea33084d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74aeffb7-3771-4676-9c90-037f032c6e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74aeffb7-3771-4676-9c90-037f032c6e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5dc22df-3749-40ef-8603-63eac593a008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5dc22df-3749-40ef-8603-63eac593a008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790291cf-eedb-4d65-9cbb-5423e2b91360', 'volume_name': 'volume-790291cf-eedb-4d65-9cbb-5423e2b91360', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a1857-17e6-4703-ae4f-1f4026e0732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a1857-17e6-4703-ae4f-1f4026e0732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9667e38-0925-4ffd-a1c2-3639c140d737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Volume 790291cf-eedb-4d65-9cbb-5423e2b91360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790291cf-eedb-4d65-9cbb-5423e2b91360', 'volume_size': 1} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1820070367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790291cf-eedb-4d65-9cbb-5423e2b91360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c795dc23f14961a8e080f1c2f428a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:15Z,use_quota=True,user_id='45023a6c73dc45829e294cdeea33084d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Creating volume 790291cf-eedb-4d65-9cbb-5423e2b91360 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:15 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:15 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 1073741824 Jul 10 05:57:15 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:16 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 1073741824" returned: 0 in 1.062s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:16 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 Jul 10 05:57:16 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:17 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9667e38-0925-4ffd-a1c2-3639c140d737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790291cf-eedb-4d65-9cbb-5423e2b91360', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f0969c-b35c-4981-b9b9-e66a8e039afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:17 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Volume volume-790291cf-eedb-4d65-9cbb-5423e2b91360 (790291cf-eedb-4d65-9cbb-5423e2b91360): created successfully Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f0969c-b35c-4981-b9b9-e66a8e039afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Flow 'volume_create_manager' (a456864c-434e-4878-b299-0ccf99d9ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-590f29f5-d62f-4ca0-8f77-66ca5e4c8be7 tempest-VolumesServicesTestJSON-1759484810 None] Created volume successfully. Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Acquiring lock "cinder-790291cf-eedb-4d65-9cbb-5423e2b91360-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Lock "cinder-790291cf-eedb-4d65-9cbb-5423e2b91360-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Acquiring lock "cinder-quobyte-790291cf-eedb-4d65-9cbb-5423e2b91360" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Lock "cinder-quobyte-790291cf-eedb-4d65-9cbb-5423e2b91360" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[027abf8d-c003-479d-9981-550e173f21a3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:18 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 Jul 10 05:57:18 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Flow 'volume_create_manager' (6f362093-e01a-4f6f-a6a2-417366805593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee43f2d-fae2-4f07-947c-3ea5c682f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee43f2d-fae2-4f07-947c-3ea5c682f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1485495645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d785ec-6be7-41da-a0d2-ca3399ee4ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed69135eac14e6490472d01eb3b7bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:18Z,use_quota=True,user_id='a125bac6ee5440019eac802b4060c40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43009987-c0b9-4137-8405-7ad29ec521de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43009987-c0b9-4137-8405-7ad29ec521de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee8bf28-ad81-4623-96cd-eef4e1e1f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee8bf28-ad81-4623-96cd-eef4e1e1f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'volume_name': 'volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae20348-cd4c-49c8-9a76-75a46c0467bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae20348-cd4c-49c8-9a76-75a46c0467bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3b460e-6322-4b47-a85c-6dbe393f635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Volume e4d785ec-6be7-41da-a0d2-ca3399ee4ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'volume_size': 1} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1485495645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d785ec-6be7-41da-a0d2-ca3399ee4ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed69135eac14e6490472d01eb3b7bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:18Z,use_quota=True,user_id='a125bac6ee5440019eac802b4060c40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Creating volume e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:18 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:18 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 1073741824 Jul 10 05:57:18 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:18 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360" returned: 0 in 1.126s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:19 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360 Jul 10 05:57:19 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:19 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 1073741824" returned: 0 in 1.135s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:19 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-790291cf-eedb-4d65-9cbb-5423e2b91360" returned: 0 in 0.816s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Lock "cinder-quobyte-790291cf-eedb-4d65-9cbb-5423e2b91360" released by "delete_volume" :: held 2.012s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:19 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:19 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:19 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Created reservations ['86e51a6f-b44d-4c25-a0e5-0628241992b5', 'aa363c48-01bc-475f-b420-1924665ff034', '91aa87b5-78f5-49c4-8a17-15b2797c265d', '307a4229-fbd6-4e48-8546-2bd69aa98ea5'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:20 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:20 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:20 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3b460e-6322-4b47-a85c-6dbe393f635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f82f05e-e4f3-4d7b-8632-e81b9112cf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Volume volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 (e4d785ec-6be7-41da-a0d2-ca3399ee4ef2): created successfully Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f82f05e-e4f3-4d7b-8632-e81b9112cf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Flow 'volume_create_manager' (6f362093-e01a-4f6f-a6a2-417366805593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:20 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6067c6bd-18c0-4ba4-aeb8-2a06134b93f8 tempest-VolumesCloneTest-1128727139 None] Created volume successfully. Jul 10 05:57:20 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.800s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:20 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Deleted volume successfully. Jul 10 05:57:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b85de509-0011-437e-b88d-697d5b4bcfa9 tempest-VolumesServicesTestJSON-1759484810 None] Lock "cinder-790291cf-eedb-4d65-9cbb-5423e2b91360-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Flow 'volume_create_manager' (c4b0a8d6-d86b-41c2-b6b2-7f4e5b746515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a4d1b7-43ac-48da-b3e4-2267b39354bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a4d1b7-43ac-48da-b3e4-2267b39354bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-444971391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055a0771-d27f-4780-8784-19812472a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed69135eac14e6490472d01eb3b7bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e4d785ec-6be7-41da-a0d2-ca3399ee4ef2,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:22Z,use_quota=True,user_id='a125bac6ee5440019eac802b4060c40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8108dfb-4a81-45ab-aeb6-0496f9c2aad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8108dfb-4a81-45ab-aeb6-0496f9c2aad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67ab3af-ffef-42a2-a5dc-234448277117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67ab3af-ffef-42a2-a5dc-234448277117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '055a0771-d27f-4780-8784-19812472a190', 'volume_name': 'volume-055a0771-d27f-4780-8784-19812472a190', 'volume_size': 2, 'source_volid': 'e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'source_volstatus': 'available'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbf1389-542c-4457-a1c0-c99ba009c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbf1389-542c-4457-a1c0-c99ba009c19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba3f230-4d8c-4644-8b8a-2e571628ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:22 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Volume 055a0771-d27f-4780-8784-19812472a190: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-055a0771-d27f-4780-8784-19812472a190', 'volume_size': 2, 'source_volid': 'e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'source_volstatus': 'available'} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:22 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Cloning volume e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 to volume 055a0771-d27f-4780-8784-19812472a190 Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Creating offline snapshot fec20d34-c3ef-4f84-9887-647aa8d13a6a of volume e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f1f8f2-0b8b-4b6d-ae62-4272c0c6f40d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:22 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:22 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-be1d3694-55d3-4bf5-847a-9e826da2c8b5 tempest-VolumesActionsTest-15700650 None] Acquiring lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c" by "attach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-be1d3694-55d3-4bf5-847a-9e826da2c8b5 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c" acquired by "attach_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=161,cinder:SELECT=109,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=151,cinder:SELECT=122,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:57:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-be1d3694-55d3-4bf5-847a-9e826da2c8b5 tempest-VolumesActionsTest-15700650 None] Attaching volume e55c911a-a974-41d1-8514-6bd4d9225f8c to instance 3515efd1-b1ee-432a-a0e0-45121627aeaf at mountpoint /dev/vdb on host None. Jul 10 05:57:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-be1d3694-55d3-4bf5-847a-9e826da2c8b5 tempest-VolumesActionsTest-15700650 None] Attach volume completed successfully. Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-be1d3694-55d3-4bf5-847a-9e826da2c8b5 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c" released by "attach_volume" :: held 0.217s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-371b6c23-914b-4cd3-b30c-269e4949b1c6 tempest-VolumesActionsTest-15700650 None] Acquiring lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-detach_volume" by "detach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-371b6c23-914b-4cd3-b30c-269e4949b1c6 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-371b6c23-914b-4cd3-b30c-269e4949b1c6 tempest-VolumesActionsTest-15700650 None] Detaching volume e55c911a-a974-41d1-8514-6bd4d9225f8c from instance 3515efd1-b1ee-432a-a0e0-45121627aeaf. Jul 10 05:57:23 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 1.343s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:23 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a 1G Jul 10 05:57:23 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-371b6c23-914b-4cd3-b30c-269e4949b1c6 tempest-VolumesActionsTest-15700650 None] Detach volume completed successfully. Jul 10 05:57:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-371b6c23-914b-4cd3-b30c-269e4949b1c6 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:25 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a 1G" returned: 0 in 1.274s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:25 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a Jul 10 05:57:25 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:26 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a" returned: 0 in 0.964s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:26 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a is being set with open permissions: ugo+rw Jul 10 05:57:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:26 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a Jul 10 05:57:26 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:27 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a" returned: 0 in 0.992s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:27 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info Jul 10 05:57:27 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:27 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:27 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info is being set with open permissions: ugo+rw Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:28 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info Jul 10 05:57:28 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:28 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.info" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Acquiring lock "cinder-quobyte-055a0771-d27f-4780-8784-19812472a190" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-055a0771-d27f-4780-8784-19812472a190" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] snapshot: fec20d34-c3ef-4f84-9887-647aa8d13a6a, volume: 055a0771-d27f-4780-8784-19812472a190, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5db08b0-8792-46a7-af09-487a3bdd1eba]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:28 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:28 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:28 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a Jul 10 05:57:28 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:29 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a" returned: 0 in 0.942s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4927b5c8-0e23-44ac-98f2-b160da28b443]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:29 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.025s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:57:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:57:29 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:29 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:30 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 0.989s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:30 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:57:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:30 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 Jul 10 05:57:30 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:36 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190" returned: 0 in 6.185s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c6888-89c3-4eb7-8619-f2a8e9220912]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:37 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:37 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:37 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:57:37 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:57:38 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 1.040s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:57:38 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Converted 1024.00 MB image at 165.46 MB/s Jul 10 05:57:38 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 is being set with open permissions: ugo+rw Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:38 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 Jul 10 05:57:38 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (783af7a8-9511-41ab-9aeb-59ebc7f9b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d223167-17c7-41a0-a827-4f351218a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d223167-17c7-41a0-a827-4f351218a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1015216574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604d54ad-3d26-43db-b930-1b73f2020927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:38Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50b416-a986-4f7e-923d-2b2a5b0fbcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50b416-a986-4f7e-923d-2b2a5b0fbcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12506d95-d329-48fe-9c0c-eb9d01ac8765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12506d95-d329-48fe-9c0c-eb9d01ac8765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604d54ad-3d26-43db-b930-1b73f2020927', 'volume_name': 'volume-604d54ad-3d26-43db-b930-1b73f2020927', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f77042f-a47b-4e19-9828-67c1efc997ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f77042f-a47b-4e19-9828-67c1efc997ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1617a3fd-72f7-413c-a381-57dad3ccc3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Volume 604d54ad-3d26-43db-b930-1b73f2020927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604d54ad-3d26-43db-b930-1b73f2020927', 'volume_size': 1} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Flow 'volume_create_manager' (cf1eb968-f4d4-4250-93be-0232a04c5957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84710aa-b97b-4360-b447-039389b562b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84710aa-b97b-4360-b447-039389b562b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1049701945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ad7c54-c75d-4d4e-abdb-ca27d152db00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998c0daeedbe4224b3332929333f5c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:39Z,use_quota=True,user_id='96901a2986ad44ddae8f71547c77861b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189be57d-7b85-42c5-9c9d-b6f506dcac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189be57d-7b85-42c5-9c9d-b6f506dcac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59361bf9-7c2e-40ef-bbd4-2fc5c70d3b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59361bf9-7c2e-40ef-bbd4-2fc5c70d3b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ad7c54-c75d-4d4e-abdb-ca27d152db00', 'volume_name': 'volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9cdc2-160a-4b12-b89f-73ba2183ce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9cdc2-160a-4b12-b89f-73ba2183ce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bf0638-8297-4bae-bcd8-2167beda9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Volume 40ad7c54-c75d-4d4e-abdb-ca27d152db00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00', 'volume_size': 1} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:38 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190" returned: 0 in 0.758s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-055a0771-d27f-4780-8784-19812472a190" released by "_copy_volume_from_snapshot" :: held 10.026s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Acquiring lock "cinder-quobyte-fec20d34-c3ef-4f84-9887-647aa8d13a6a" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-fec20d34-c3ef-4f84-9887-647aa8d13a6a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Deleting offline snapshot fec20d34-c3ef-4f84-9887-647aa8d13a6a of volume e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] snapshot_file for this snap is: volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2860e2e0-f7bb-4bd6-8e91-442ecc3ad0d4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:38 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a Jul 10 05:57:38 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:39 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a" returned: 0 in 0.761s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:57:39 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea9dfdb-05fa-4212-9fec-c1404004bab0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:39 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:39 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:40 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 0.749s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:40 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a Jul 10 05:57:40 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:41 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a" returned: 0 in 0.732s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:41 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a Jul 10 05:57:41 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:41 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2.fec20d34-c3ef-4f84-9887-647aa8d13a6a" returned: 0 in 0.644s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-fec20d34-c3ef-4f84-9887-647aa8d13a6a" released by "_delete_snapshot" :: held 2.982s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.355s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1015216574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604d54ad-3d26-43db-b930-1b73f2020927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:38Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Creating volume 604d54ad-3d26-43db-b930-1b73f2020927 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:41 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba3f230-4d8c-4644-8b8a-2e571628ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055a0771-d27f-4780-8784-19812472a190', 'volume_size': 2, 'source_volid': 'e4d785ec-6be7-41da-a0d2-ca3399ee4ef2', 'source_volstatus': 'available'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:41 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 1073741824 Jul 10 05:57:41 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170b9de5-7722-46bc-a404-4d2c1b7222db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Volume volume-055a0771-d27f-4780-8784-19812472a190 (055a0771-d27f-4780-8784-19812472a190): created successfully Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170b9de5-7722-46bc-a404-4d2c1b7222db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Flow 'volume_create_manager' (c4b0a8d6-d86b-41c2-b6b2-7f4e5b746515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c08f92ca-28c2-47b4-81e5-6b9df55a5e7d tempest-VolumesCloneTest-1128727139 None] Created volume successfully. Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "cinder-055a0771-d27f-4780-8784-19812472a190-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-055a0771-d27f-4780-8784-19812472a190-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "cinder-quobyte-055a0771-d27f-4780-8784-19812472a190" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-055a0771-d27f-4780-8784-19812472a190" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e494d8-1669-47eb-b734-4a77b21a2ae7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:42 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 1073741824" returned: 0 in 1.110s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:43 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 Jul 10 05:57:43 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:43 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 Jul 10 05:57:43 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:43 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190" returned: 0 in 0.905s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:43 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190 Jul 10 05:57:43 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:43 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927" returned: 0 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.151s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1049701945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ad7c54-c75d-4d4e-abdb-ca27d152db00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998c0daeedbe4224b3332929333f5c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:39Z,use_quota=True,user_id='96901a2986ad44ddae8f71547c77861b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Creating volume 40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:43 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1617a3fd-72f7-413c-a381-57dad3ccc3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604d54ad-3d26-43db-b930-1b73f2020927', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:43 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 1073741824 Jul 10 05:57:43 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11973af-9fd4-41d1-a42f-1d032e4b88b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:43 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Volume volume-604d54ad-3d26-43db-b930-1b73f2020927 (604d54ad-3d26-43db-b930-1b73f2020927): created successfully Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11973af-9fd4-41d1-a42f-1d032e4b88b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (783af7a8-9511-41ab-9aeb-59ebc7f9b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4a9a4450-132e-4756-a0f0-c53f3f2ec23e tempest-ProjectReaderTests-1315518678 None] Created volume successfully. Jul 10 05:57:44 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-055a0771-d27f-4780-8784-19812472a190" returned: 0 in 0.701s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-055a0771-d27f-4780-8784-19812472a190" released by "delete_volume" :: held 1.655s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Created reservations ['981252f3-e2fa-4508-ab85-c6e0b10fe0a6', '3cf33f4f-a09c-4b5b-991e-edcd8aba93a8', 'a70061b6-9d08-4a7c-bbc7-7e01ed564bf9', 'f2e93929-9d4d-4c29-bfc7-1fed3d6cbefd'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:44 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:44 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-604d54ad-3d26-43db-b930-1b73f2020927-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-604d54ad-3d26-43db-b930-1b73f2020927-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:44 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 1073741824" returned: 0 in 0.915s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-quobyte-604d54ad-3d26-43db-b930-1b73f2020927" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-604d54ad-3d26-43db-b930-1b73f2020927" acquired by "delete_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:44 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 Jul 10 05:57:44 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31d485-53ca-405b-9d3b-796a55b747e8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:45 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 Jul 10 05:57:45 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "cinder-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "cinder-quobyte-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62e132-18fa-45f8-ad13-c37ef4284644]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:45 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:45 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:45 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.940s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Deleted volume successfully. Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-568541cf-4479-4dad-99ca-2a1dca5b4a38 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-055a0771-d27f-4780-8784-19812472a190-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:45 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00" returned: 0 in 0.927s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bf0638-8297-4bae-bcd8-2167beda9410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc10765-b3fe-4ef7-8869-4d5c1f55271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:45 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Volume volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 (40ad7c54-c75d-4d4e-abdb-ca27d152db00): created successfully Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc10765-b3fe-4ef7-8869-4d5c1f55271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Flow 'volume_create_manager' (cf1eb968-f4d4-4250-93be-0232a04c5957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e349f585-81ca-4b66-9ee7-a2c615e8d5cf tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Created volume successfully. Jul 10 05:57:45 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927" returned: 0 in 0.946s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:45 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927 Jul 10 05:57:45 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:46 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 0.918s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Creating offline snapshot bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 of volume 40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:57:46 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2 Jul 10 05:57:46 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a463c6c-874f-4ea5-9db3-e996baec2903]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:46 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 Jul 10 05:57:46 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:46 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-604d54ad-3d26-43db-b930-1b73f2020927" returned: 0 in 0.767s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-604d54ad-3d26-43db-b930-1b73f2020927" released by "delete_volume" :: held 1.786s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Created reservations ['6afcfe65-5e12-44f9-ae89-d5f24bb72477', 'ed9a651d-66ca-4f09-8db8-05ae3809241d', '0d8b4c59-d76b-4dbd-a6be-bb394c3026f6', '9f406134-dab5-4b0b-8306-cfbbbf09ed56'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:46 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:46 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:47 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" returned: 0 in 0.787s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-quobyte-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2" released by "delete_volume" :: held 1.790s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Created reservations ['f6fae0b6-6652-4b59-a7a3-102265729576', '545e67a1-6e5e-4e12-8080-ad8baedec03f', '99cd1be8-3016-41db-b279-41cacd83b011', 'ef340f4b-f0ed-4a16-a84c-61bd9039a826'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:47 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00" returned: 0 in 1.175s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:47 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:47 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:47 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 1G Jul 10 05:57:47 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (e5393eb9-a272-494b-913f-3b3d267cd8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2f181b-fa6a-45a0-a1a1-331f275233a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2f181b-fa6a-45a0-a1a1-331f275233a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755587451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaba13a-f9ac-4eab-b83f-0333d527c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:48Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:48 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0294bf-75ab-4ee6-907d-d25e46334878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0294bf-75ab-4ee6-907d-d25e46334878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1689bb7a-f2c4-4bfd-8270-461f33a8de3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1689bb7a-f2c4-4bfd-8270-461f33a8de3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eaba13a-f9ac-4eab-b83f-0333d527c89c', 'volume_name': 'volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ae1109-b5da-4543-abb6-960fc2640857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ae1109-b5da-4543-abb6-960fc2640857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c48985d-3d54-4f9f-b793-dd4ce473c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:48 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Volume 5eaba13a-f9ac-4eab-b83f-0333d527c89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c', 'volume_size': 1} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.512s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Deleted volume successfully. Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8c1d3395-afe7-49c4-b4af-2b95e5c17897 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-604d54ad-3d26-43db-b930-1b73f2020927-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:48 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.200s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Deleted volume successfully. Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58988c9f-b91d-4a43-97bc-0a62eac95384 tempest-VolumesCloneTest-1128727139 None] Lock "cinder-e4d785ec-6be7-41da-a0d2-ca3399ee4ef2-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:48 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 1G" returned: 0 in 1.414s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:48 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 Jul 10 05:57:48 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:49 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" returned: 0 in 0.847s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:49 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 is being set with open permissions: ugo+rw Jul 10 05:57:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:49 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 Jul 10 05:57:49 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:50 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:50 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info Jul 10 05:57:50 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:51 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info" returned: 0 in 0.903s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:51 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info is being set with open permissions: ugo+rw Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:51 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info Jul 10 05:57:51 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Flow 'volume_create_manager' (32a85f25-2ec7-4ea8-9135-4a010c567763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57670ae9-516f-47fc-b887-76822d7e3b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57670ae9-516f-47fc-b887-76822d7e3b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1117154215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3868b389-a747-491a-a56a-8ee9afbd431e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34dfc045111345cd8906414cd45cc996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:51Z,use_quota=True,user_id='462b35983c554d3eba1057d8f38f2a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3ddc4c-10a7-43ab-a38f-8cb63dadb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3ddc4c-10a7-43ab-a38f-8cb63dadb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77711be3-6256-4ffd-847b-1f52dc7f3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77711be3-6256-4ffd-847b-1f52dc7f3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3868b389-a747-491a-a56a-8ee9afbd431e', 'volume_name': 'volume-3868b389-a747-491a-a56a-8ee9afbd431e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4925c744-0e0c-404f-b145-803dbbda9ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4925c744-0e0c-404f-b145-803dbbda9ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1846235b-fe6c-4c66-b358-a49f259df951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:51 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Volume 3868b389-a747-491a-a56a-8ee9afbd431e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3868b389-a747-491a-a56a-8ee9afbd431e', 'volume_size': 1} Jul 10 05:57:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46dbb139-a241-46a7-8310-74dfc92b0c86 tempest-VolumesActionsTest-15700650 None] Acquiring lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c" by "attach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:52 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46dbb139-a241-46a7-8310-74dfc92b0c86 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c" acquired by "attach_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.info" returned: 0 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.998s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.989s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755587451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaba13a-f9ac-4eab-b83f-0333d527c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:48Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Creating volume 5eaba13a-f9ac-4eab-b83f-0333d527c89c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:52 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:52 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c 1073741824 Jul 10 05:57:52 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-26e20c3f-b408-46a9-b9ca-3d31610af9f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Create snapshot completed successfully Jul 10 05:57:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-46dbb139-a241-46a7-8310-74dfc92b0c86 tempest-VolumesActionsTest-15700650 None] Attaching volume e55c911a-a974-41d1-8514-6bd4d9225f8c to instance 32c65698-be28-40e7-a93f-1cf2b4f3789c at mountpoint /dev/vdb on host None. Jul 10 05:57:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-46dbb139-a241-46a7-8310-74dfc92b0c86 tempest-VolumesActionsTest-15700650 None] Attach volume completed successfully. Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46dbb139-a241-46a7-8310-74dfc92b0c86 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c" released by "attach_volume" :: held 0.184s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7bde4fad-515e-41ce-b9f2-52cc7308d2a7 tempest-VolumesActionsTest-15700650 None] Acquiring lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-detach_volume" by "detach_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7bde4fad-515e-41ce-b9f2-52cc7308d2a7 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7bde4fad-515e-41ce-b9f2-52cc7308d2a7 tempest-VolumesActionsTest-15700650 None] Detaching volume e55c911a-a974-41d1-8514-6bd4d9225f8c from instance 32c65698-be28-40e7-a93f-1cf2b4f3789c. Jul 10 05:57:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7bde4fad-515e-41ce-b9f2-52cc7308d2a7 tempest-VolumesActionsTest-15700650 None] Detach volume completed successfully. Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7bde4fad-515e-41ce-b9f2-52cc7308d2a7 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:53 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c 1073741824" returned: 0 in 0.967s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "cinder-bc391b0e-a21c-4cd0-bf32-a2434e80ffd1-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:53 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c Jul 10 05:57:53 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-bc391b0e-a21c-4cd0-bf32-a2434e80ffd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "cinder-quobyte-40ad7c54-c75d-4d4e-abdb-ca27d152db00" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-quobyte-40ad7c54-c75d-4d4e-abdb-ca27d152db00" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "cinder-quobyte-bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-quobyte-bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Deleting offline snapshot bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 of volume 40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] snapshot_file for this snap is: volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f124bf12-5f5c-4107-948a-2b7cf96c23dc]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:53 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 Jul 10 05:57:53 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:54 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c" returned: 0 in 0.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1117154215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3868b389-a747-491a-a56a-8ee9afbd431e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34dfc045111345cd8906414cd45cc996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:51Z,use_quota=True,user_id='462b35983c554d3eba1057d8f38f2a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Creating volume 3868b389-a747-491a-a56a-8ee9afbd431e {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:54 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:54 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e 1073741824 Jul 10 05:57:54 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c48985d-3d54-4f9f-b793-dd4ce473c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f519910c-b379-45d9-aba1-6cc28d68b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:54 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Volume volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c (5eaba13a-f9ac-4eab-b83f-0333d527c89c): created successfully Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f519910c-b379-45d9-aba1-6cc28d68b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (e5393eb9-a272-494b-913f-3b3d267cd8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1c1c8058-b8e3-42f5-8915-5221d82984f7 tempest-ProjectReaderTests-1315518678 None] Created volume successfully. Jul 10 05:57:54 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" returned: 0 in 0.918s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b8007-bc17-4762-b61c-c16b1d3088df]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-5eaba13a-f9ac-4eab-b83f-0333d527c89c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:54 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 Jul 10 05:57:54 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Lock "cinder-5eaba13a-f9ac-4eab-b83f-0333d527c89c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-quobyte-5eaba13a-f9ac-4eab-b83f-0333d527c89c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-5eaba13a-f9ac-4eab-b83f-0333d527c89c" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d8b34-6ef4-405d-bbcf-1f89624c9310]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:54 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c Jul 10 05:57:54 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:55 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e 1073741824" returned: 0 in 0.999s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:55 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e Jul 10 05:57:55 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:55 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00" returned: 0 in 0.935s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:55 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 Jul 10 05:57:55 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:55 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c" returned: 0 in 0.926s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:55 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c Jul 10 05:57:55 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:56 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e" returned: 0 in 0.927s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1846235b-fe6c-4c66-b358-a49f259df951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3868b389-a747-491a-a56a-8ee9afbd431e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd70838-64f8-487e-9cd4-f41a00e62cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:56 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Volume volume-3868b389-a747-491a-a56a-8ee9afbd431e (3868b389-a747-491a-a56a-8ee9afbd431e): created successfully Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd70838-64f8-487e-9cd4-f41a00e62cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Flow 'volume_create_manager' (32a85f25-2ec7-4ea8-9135-4a010c567763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d43a6fb7-c174-4bc7-86f2-24d9f96f268f tempest-VolumesListTestJSON-1753369028 None] Created volume successfully. Jul 10 05:57:56 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5eaba13a-f9ac-4eab-b83f-0333d527c89c" returned: 0 in 0.965s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-5eaba13a-f9ac-4eab-b83f-0333d527c89c" released by "delete_volume" :: held 1.938s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Created reservations ['1dd69435-3439-4ae6-bfe1-c4907afd3b4b', '4d75c899-0ec9-4dc9-8598-40daeab2b93e', '32ab7291-3311-429d-8f46-58b5bcef7fed', 'efd0f4c1-cd36-43aa-b873-7864ee71dda8'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:56 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" returned: 0 in 1.363s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:56 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1 Jul 10 05:57:56 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:56 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:57:56 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:57 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.858s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:57:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Deleted volume successfully. Jul 10 05:57:57 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00.bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" returned: 0 in 0.969s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9f8708c1-6936-4dcb-9b13-df7d39f9ea5e tempest-ProjectReaderTests-1315518678 None] Lock "cinder-5eaba13a-f9ac-4eab-b83f-0333d527c89c-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-quobyte-bc391b0e-a21c-4cd0-bf32-a2434e80ffd1" released by "_delete_snapshot" :: held 4.317s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-quobyte-40ad7c54-c75d-4d4e-abdb-ca27d152db00" released by "delete_snapshot" :: held 4.349s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Created reservations ['5f348574-7160-4473-84d4-60973eda51bf', 'cd381540-a523-4017-bb5f-367b573b821d', 'b77e5d71-d666-469f-8b96-7d273e325b98', '73914c31-b47c-4329-97fe-1f8501a092c0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:57:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Delete snapshot completed successfully. Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-91df77ce-ecf4-462d-8f02-ff2c790535a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-bc391b0e-a21c-4cd0-bf32-a2434e80ffd1-delete_snapshot" released by "delete_snapshot" :: held 4.541s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (4ec71fa7-75fa-4bce-94df-63ee7034f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5cd58-7193-4f63-90ce-512d5f6c128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5cd58-7193-4f63-90ce-512d5f6c128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-762904647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7deaa475-19c5-432f-b02b-6a49b9416a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:58Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5677ae3-53b4-4e85-93f2-347191b85c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5677ae3-53b4-4e85-93f2-347191b85c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8138526-7080-43e3-8efc-d155cf35d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8138526-7080-43e3-8efc-d155cf35d515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7deaa475-19c5-432f-b02b-6a49b9416a06', 'volume_name': 'volume-7deaa475-19c5-432f-b02b-6a49b9416a06', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f0eaa6-69c2-4447-bcbd-b86ab3bc8679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f0eaa6-69c2-4447-bcbd-b86ab3bc8679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d133a7e6-b14f-47d4-a57f-fc565c1f2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:57 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Volume 7deaa475-19c5-432f-b02b-6a49b9416a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7deaa475-19c5-432f-b02b-6a49b9416a06', 'volume_size': 1} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-762904647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7deaa475-19c5-432f-b02b-6a49b9416a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:58Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Creating volume 7deaa475-19c5-432f-b02b-6a49b9416a06 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:57 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:57:58 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 1073741824 Jul 10 05:57:58 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Flow 'volume_create_manager' (73ebdea4-31e0-4143-9835-8aae4db32665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63a7869-1189-4ed1-9148-97e4fe5fbc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63a7869-1189-4ed1-9148-97e4fe5fbc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-710671714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92def0c6-fd9a-4e30-8d11-a0cb34ae436d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34dfc045111345cd8906414cd45cc996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:58Z,use_quota=True,user_id='462b35983c554d3eba1057d8f38f2a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d17ce54-9e47-44ce-ac0d-56ecac342a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d17ce54-9e47-44ce-ac0d-56ecac342a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31b79c6-1abf-4336-9b6a-91884a16f0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31b79c6-1abf-4336-9b6a-91884a16f0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92def0c6-fd9a-4e30-8d11-a0cb34ae436d', 'volume_name': 'volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbef6c0-6fb3-40db-ac19-d793eaf24829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbef6c0-6fb3-40db-ac19-d793eaf24829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64686581-8515-41a1-94e7-158d9b06b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:58 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Volume 92def0c6-fd9a-4e30-8d11-a0cb34ae436d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d', 'volume_size': 1} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "cinder-40ad7c54-c75d-4d4e-abdb-ca27d152db00-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-40ad7c54-c75d-4d4e-abdb-ca27d152db00-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "cinder-quobyte-40ad7c54-c75d-4d4e-abdb-ca27d152db00" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-quobyte-40ad7c54-c75d-4d4e-abdb-ca27d152db00" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd801b4-138c-49da-92f5-4e322878b816]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:58 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 Jul 10 05:57:58 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:58 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 1073741824" returned: 0 in 0.924s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:58 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 Jul 10 05:57:58 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:59 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00" returned: 0 in 0.756s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:59 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00 Jul 10 05:57:59 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:59 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06" returned: 0 in 0.694s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.538s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-710671714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92def0c6-fd9a-4e30-8d11-a0cb34ae436d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34dfc045111345cd8906414cd45cc996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:57:58Z,use_quota=True,user_id='462b35983c554d3eba1057d8f38f2a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Creating volume 92def0c6-fd9a-4e30-8d11-a0cb34ae436d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:57:59 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d133a7e6-b14f-47d4-a57f-fc565c1f2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7deaa475-19c5-432f-b02b-6a49b9416a06', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:59 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d 1073741824 Jul 10 05:57:59 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e64db-871a-4cbc-8adc-419d3f5b7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:57:59 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Volume volume-7deaa475-19c5-432f-b02b-6a49b9416a06 (7deaa475-19c5-432f-b02b-6a49b9416a06): created successfully Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e64db-871a-4cbc-8adc-419d3f5b7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:57:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (4ec71fa7-75fa-4bce-94df-63ee7034f82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:57:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-99e59dd5-28d5-4e7a-af42-e4b85f9ee94a tempest-ProjectReaderTests-1315518678 None] Created volume successfully. Jul 10 05:58:00 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-40ad7c54-c75d-4d4e-abdb-ca27d152db00" returned: 0 in 0.674s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-quobyte-40ad7c54-c75d-4d4e-abdb-ca27d152db00" released by "delete_volume" :: held 1.487s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Created reservations ['75de153a-3fdf-40c9-aebb-080f0d14a86e', 'b4cbe579-9252-4a76-9503-2b5bf0039956', '8d3c2fe9-5a14-4b37-ae16-b62f0d91304b', '801293e1-6a45-4105-80a9-083b27f2c5d1'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:00 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:00 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:00 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d 1073741824" returned: 0 in 0.893s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:00 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d Jul 10 05:58:00 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-7deaa475-19c5-432f-b02b-6a49b9416a06-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Lock "cinder-7deaa475-19c5-432f-b02b-6a49b9416a06-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-quobyte-7deaa475-19c5-432f-b02b-6a49b9416a06" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-7deaa475-19c5-432f-b02b-6a49b9416a06" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d04e4-cd1e-48c2-aad8-c2aa7a4b4e21]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:01 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 Jul 10 05:58:01 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:01 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Deleted volume successfully. Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-58667b30-10fa-4d0a-86e5-9a1930e3ea82 tempest-VolumeSnapshotQuotasNegativeTestJSON-683606507 None] Lock "cinder-40ad7c54-c75d-4d4e-abdb-ca27d152db00-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:01 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d" returned: 0 in 0.758s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64686581-8515-41a1-94e7-158d9b06b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f5c096-c21f-4b88-bdf3-d1c154685e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Volume volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d (92def0c6-fd9a-4e30-8d11-a0cb34ae436d): created successfully Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f5c096-c21f-4b88-bdf3-d1c154685e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Flow 'volume_create_manager' (73ebdea4-31e0-4143-9835-8aae4db32665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-13194e72-113b-4eab-af59-d24adf2ef19c tempest-VolumesListTestJSON-1753369028 None] Created volume successfully. Jul 10 05:58:01 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06" returned: 0 in 0.847s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:01 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06 Jul 10 05:58:01 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:02 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7deaa475-19c5-432f-b02b-6a49b9416a06" returned: 0 in 0.780s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-7deaa475-19c5-432f-b02b-6a49b9416a06" released by "delete_volume" :: held 1.706s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Flow 'volume_create_manager' (d4c8a5f4-c7be-4630-bca7-f94911c5be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fc168b-e425-4da9-ab6a-3f4a59ae7492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fc168b-e425-4da9-ab6a-3f4a59ae7492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-712613676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34dfc045111345cd8906414cd45cc996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:03Z,use_quota=True,user_id='462b35983c554d3eba1057d8f38f2a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893e329a-c752-474c-9dfb-127704507c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893e329a-c752-474c-9dfb-127704507c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3834e106-eaf4-43ed-b881-e46cdd65af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3834e106-eaf4-43ed-b881-e46cdd65af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9', 'volume_name': 'volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbb7199-f5b9-474b-80c7-5b6f25565aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbb7199-f5b9-474b-80c7-5b6f25565aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0313c73c-828a-45a4-8eab-ac9021bdb797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:02 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Volume e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9', 'volume_size': 1} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-712613676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34dfc045111345cd8906414cd45cc996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:03Z,use_quota=True,user_id='462b35983c554d3eba1057d8f38f2a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Creating volume e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:58:02 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:02 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 1073741824 Jul 10 05:58:02 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Created reservations ['610e5847-28c7-4e8e-96bf-d3a461660f76', '670bc9e6-ca9e-45b8-9e89-05f0a3548adc', '86c0b85a-7ec5-4f25-8049-dd6a023f7ee7', 'f14f4d2b-329c-4a9f-affc-c764790c4b52'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:02 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:02 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:03 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:58:03 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (04378d31-d59a-43c4-b040-8faba081f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0265bf-11eb-4f29-ac07-83f2491ead7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.155s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Deleted volume successfully. Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0265bf-11eb-4f29-ac07-83f2491ead7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026550196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef8bc67-acf3-4b66-a6d0-023caddb7692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:04Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:04 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d2b4d0-a055-4b55-84a6-07c843f0d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d2b4d0-a055-4b55-84a6-07c843f0d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b6ea1c-c6cf-4710-bea6-a1cb479d1db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b6ea1c-c6cf-4710-bea6-a1cb479d1db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef8bc67-acf3-4b66-a6d0-023caddb7692', 'volume_name': 'volume-bef8bc67-acf3-4b66-a6d0-023caddb7692', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3074a163-56cd-46c3-b4b3-5f6635ba269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3074a163-56cd-46c3-b4b3-5f6635ba269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a062545c-a717-462d-932e-90f1680845a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:04 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Volume bef8bc67-acf3-4b66-a6d0-023caddb7692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef8bc67-acf3-4b66-a6d0-023caddb7692', 'volume_size': 1} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 1073741824" returned: 0 in 1.395s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9910968a-168e-48fb-b9da-96abf17e041d tempest-ProjectReaderTests-1315518678 None] Lock "cinder-7deaa475-19c5-432f-b02b-6a49b9416a06-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:04 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 Jul 10 05:58:04 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:04 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9" returned: 0 in 0.704s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026550196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef8bc67-acf3-4b66-a6d0-023caddb7692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0751a4ffed40f39fd28cf385c76b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:04Z,use_quota=True,user_id='a9beb97aafcf4d5a896bb7cda1e6c647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Creating volume bef8bc67-acf3-4b66-a6d0-023caddb7692 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:58:04 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0313c73c-828a-45a4-8eab-ac9021bdb797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:04 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 1073741824 Jul 10 05:58:04 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd078af-1e11-4de2-bbc0-afe9b826af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:04 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Volume volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 (e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9): created successfully Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd078af-1e11-4de2-bbc0-afe9b826af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:04 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Flow 'volume_create_manager' (d4c8a5f4-c7be-4630-bca7-f94911c5be4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a325db10-d5a2-4634-91a4-3a1874089ec3 tempest-VolumesListTestJSON-1753369028 None] Created volume successfully. Jul 10 05:58:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:05 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 1073741824" returned: 0 in 1.020s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:06 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 Jul 10 05:58:06 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:06 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692" returned: 0 in 0.746s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.701s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a062545c-a717-462d-932e-90f1680845a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef8bc67-acf3-4b66-a6d0-023caddb7692', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c29253-8194-41f0-a1a5-9d039101595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89fdf80-d86f-4112-855b-f47ad98b7e1d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:06 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Volume volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 (bef8bc67-acf3-4b66-a6d0-023caddb7692): created successfully Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c29253-8194-41f0-a1a5-9d039101595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Flow 'volume_create_manager' (04378d31-d59a-43c4-b040-8faba081f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-12fb22d2-ff37-4f6d-8713-eb44c5e6522c tempest-ProjectReaderTests-1315518678 None] Created volume successfully. Jul 10 05:58:06 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:06 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-bef8bc67-acf3-4b66-a6d0-023caddb7692-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-bef8bc67-acf3-4b66-a6d0-023caddb7692-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "cinder-quobyte-bef8bc67-acf3-4b66-a6d0-023caddb7692" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-bef8bc67-acf3-4b66-a6d0-023caddb7692" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7604378e-3289-4659-9c7b-93c5150cf248]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:07 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 Jul 10 05:58:07 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:07 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.945s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3780395-cd74-4a58-bbaa-bdefc5794f3b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:07 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:07 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:08 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692" returned: 0 in 1.014s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:08 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692 Jul 10 05:58:08 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "cinder-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "cinder-quobyte-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-quobyte-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5298774-8605-4e9b-a2fa-8f7895212583]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:08 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 1.053s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.90e22f9a-503a-4d73-b4bb-7f110b99e13fgfbzp98n.img {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:08 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 Jul 10 05:58:08 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:08 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.90e22f9a-503a-4d73-b4bb-7f110b99e13fgfbzp98n.img Jul 10 05:58:08 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:09 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bef8bc67-acf3-4b66-a6d0-023caddb7692" returned: 0 in 0.870s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-quobyte-bef8bc67-acf3-4b66-a6d0-023caddb7692" released by "delete_volume" :: held 1.951s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Created reservations ['702d961c-9d1f-4ad9-952f-9b740feebfc0', 'b2aa4357-16fa-4400-8993-4f101c62e44c', 'a002564c-d136-483b-8059-693582f32125', '426616a9-4a17-4f1d-b728-cc9adc3b2e6c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:09 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:09 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:09 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9" returned: 0 in 0.970s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:09 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9 Jul 10 05:58:09 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:10 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.425s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:10 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Deleted volume successfully. Jul 10 05:58:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9a987ee1-473e-4dac-abdf-579f849becb3 tempest-ProjectReaderTests-1315518678 None] Lock "cinder-bef8bc67-acf3-4b66-a6d0-023caddb7692-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:11 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9" returned: 0 in 1.395s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-quobyte-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9" released by "delete_volume" :: held 2.423s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Created reservations ['90ab7796-7d8f-443f-a6c3-ce0355db026e', 'c004b338-5326-4971-984e-dbd53b94f49a', '823af965-51e9-444e-9d7a-8159b482e319', '9ddbdfa9-c6d8-474a-8a1d-92c81bdcc0eb'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:11 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:11 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "cinder-92def0c6-fd9a-4e30-8d11-a0cb34ae436d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-92def0c6-fd9a-4e30-8d11-a0cb34ae436d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "cinder-quobyte-92def0c6-fd9a-4e30-8d11-a0cb34ae436d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-quobyte-92def0c6-fd9a-4e30-8d11-a0cb34ae436d" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:12 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1361af86-5d5a-4cbc-ae6d-5d6a9f02a181]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:12 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d Jul 10 05:58:12 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:13 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:13 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:13 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Deleted volume successfully. Jul 10 05:58:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec4e12c1-e53f-447d-922d-a1f00fbd14ad tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-e1e2d116-e76f-4fa6-8e58-bfbd6e8bf9b9-delete_volume" released by "delete_volume" :: held 4.660s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:14 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d" returned: 0 in 2.086s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:14 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d Jul 10 05:58:14 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:15 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.90e22f9a-503a-4d73-b4bb-7f110b99e13fgfbzp98n.img" returned: 0 in 6.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f929b-a072-4965-96c5-cd56a3caf0a3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:15 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:15 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:15 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-92def0c6-fd9a-4e30-8d11-a0cb34ae436d" returned: 0 in 1.062s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-quobyte-92def0c6-fd9a-4e30-8d11-a0cb34ae436d" released by "delete_volume" :: held 3.236s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Created reservations ['8cdf5da1-0726-4e42-a224-985d77f0987b', '865609a7-6845-41e4-b519-5be2f4e703a1', '2f3dc903-ee71-4456-b902-db919f048e51', 'f6afe3ce-e3a5-48b1-9bbf-9385ef29250f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:15 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:15 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "cinder-3868b389-a747-491a-a56a-8ee9afbd431e-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-3868b389-a747-491a-a56a-8ee9afbd431e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "cinder-quobyte-3868b389-a747-491a-a56a-8ee9afbd431e" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-quobyte-3868b389-a747-491a-a56a-8ee9afbd431e" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a983dcf-e501-49fe-a6a9-0d2f4913cefe]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:16 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e Jul 10 05:58:16 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:16 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 1.300s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.90e22f9a-503a-4d73-b4bb-7f110b99e13fgfbzp98n.img {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:58:16 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Converted 1024.00 MB image at 153.07 MB/s Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] 90e22f9a-503a-4d73-b4bb-7f110b99e13f was raw, no need to convert to raw {{(pid=87449) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1161}} Jul 10 05:58:16 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.010s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:16 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Deleted volume successfully. Jul 10 05:58:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7e701182-22d0-4dca-9dad-c0e585804d4a tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-92def0c6-fd9a-4e30-8d11-a0cb34ae436d-delete_volume" released by "delete_volume" :: held 4.583s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:17 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e" returned: 0 in 1.169s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:17 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e Jul 10 05:58:17 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Flow 'volume_create_manager' (7497f32a-c9a0-4d09-84fc-09e5c246d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c308b4-b8a0-4bc7-9b35-2e26e62dff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c308b4-b8a0-4bc7-9b35-2e26e62dff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1269404884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709ade77-b989-4e91-85ee-f4fdebf4c7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b57edaaed044c6a4b85bcd41b89f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:18Z,use_quota=True,user_id='18b54dd3ae214001970e3896bc8c7990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b480246-6f78-4c04-9d1a-1e41bd7f1ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b480246-6f78-4c04-9d1a-1e41bd7f1ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63429d48-bf57-427e-a012-0a4026b4c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63429d48-bf57-427e-a012-0a4026b4c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709ade77-b989-4e91-85ee-f4fdebf4c7a6', 'volume_name': 'volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccbdcf3-74b9-47cb-8f3d-951136eda68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccbdcf3-74b9-47cb-8f3d-951136eda68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ce88ce-0966-43d7-827a-4ba931e0b958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Volume 709ade77-b989-4e91-85ee-f4fdebf4c7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6', 'volume_size': 1} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:18 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3868b389-a747-491a-a56a-8ee9afbd431e" returned: 0 in 0.843s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-quobyte-3868b389-a747-491a-a56a-8ee9afbd431e" released by "delete_volume" :: held 2.075s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Created reservations ['2826c2d0-1a8b-4110-b715-d9d30c6e8aa9', 'be7eff9e-c816-4f27-a713-d01ad6676aee', '23c24941-540f-49af-9515-67c649307462', 'db5c668f-39c5-49cb-87d3-9c2d2a07134b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:18 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:18 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:19 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.738s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:19 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Deleted volume successfully. Jul 10 05:58:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1482f747-d29d-449a-8a24-927e7988018f tempest-VolumesListTestJSON-1753369028 None] Lock "cinder-3868b389-a747-491a-a56a-8ee9afbd431e-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Flow 'volume_create_manager' (90d42191-f1fb-4de2-8d64-2c4627693b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b0f77b-9a8f-40c9-b051-a820a7093791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b0f77b-9a8f-40c9-b051-a820a7093791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2069351587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a1ac7f-8816-49ad-a04b-31b82b695321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c348f107634e1f981e557263e25c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:23Z,use_quota=True,user_id='e18bd32574b34ab5b05ba282d8265efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62f3fda-6d0e-439f-b12b-f8dc67ebb890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62f3fda-6d0e-439f-b12b-f8dc67ebb890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9ad9eb-79ca-433d-9d17-37fa5621bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9ad9eb-79ca-433d-9d17-37fa5621bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a1ac7f-8816-49ad-a04b-31b82b695321', 'volume_name': 'volume-a5a1ac7f-8816-49ad-a04b-31b82b695321', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ecae4b-8acc-4cdd-89cd-877bdb154072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ecae4b-8acc-4cdd-89cd-877bdb154072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea94fb7f-1a2f-4292-a0e5-3fea127944a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:23 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Volume a5a1ac7f-8816-49ad-a04b-31b82b695321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a1ac7f-8816-49ad-a04b-31b82b695321', 'volume_size': 1} Jul 10 05:58:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:28 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:28 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:29 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.884s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:58:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:58:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:58:33 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=92,cinder:UPDATE=110,cinder:DELETE=11,cinder:INSERT=24 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:58:33 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=80,cinder:UPDATE=127,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.555s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Uploaded volume to glance image-id: 90e22f9a-503a-4d73-b4bb-7f110b99e13f. {{(pid=87449) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.077s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1269404884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709ade77-b989-4e91-85ee-f4fdebf4c7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b57edaaed044c6a4b85bcd41b89f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:18Z,use_quota=True,user_id='18b54dd3ae214001970e3896bc8c7990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Creating volume 709ade77-b989-4e91-85ee-f4fdebf4c7a6 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:58:39 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:58:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7b52b2dc-295f-4875-8afc-167feab9b0a5 tempest-VolumesActionsTest-15700650 None] Copy volume to image completed successfully. Jul 10 05:58:39 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 1073741824 Jul 10 05:58:39 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:40 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 1073741824" returned: 0 in 0.922s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:40 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 Jul 10 05:58:40 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Flow 'volume_create_manager' (f1b54454-3508-40d3-a6c9-f82004332306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799a6a9b-5282-45af-a2b2-14420aa33883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799a6a9b-5282-45af-a2b2-14420aa33883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1035302438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b27a0f6-d51c-44e0-af4b-4867ba08b948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de68037e464d3389c9d43880030d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:40Z,use_quota=True,user_id='0abfd57d19814de3b41dfb40d56c77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5190ef6-5b37-48ff-bf9d-e6f414559999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5190ef6-5b37-48ff-bf9d-e6f414559999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67a9cd6-a5cc-4517-b2bf-9b6881663f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67a9cd6-a5cc-4517-b2bf-9b6881663f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b27a0f6-d51c-44e0-af4b-4867ba08b948', 'volume_name': 'volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b5a98d-f97f-4ad7-a315-14555d67edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b5a98d-f97f-4ad7-a315-14555d67edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b666dd-3475-478d-871b-fc0369e2d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Volume 9b27a0f6-d51c-44e0-af4b-4867ba08b948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948', 'volume_size': 1} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:40 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6" returned: 0 in 0.673s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.515s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2069351587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a1ac7f-8816-49ad-a04b-31b82b695321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c348f107634e1f981e557263e25c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:23Z,use_quota=True,user_id='e18bd32574b34ab5b05ba282d8265efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Creating volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:58:40 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:40 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 1073741824 Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ce88ce-0966-43d7-827a-4ba931e0b958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:40 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc87c788-f7cc-4284-9b40-bbfa82099ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Volume volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 (709ade77-b989-4e91-85ee-f4fdebf4c7a6): created successfully Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc87c788-f7cc-4284-9b40-bbfa82099ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Flow 'volume_create_manager' (7497f32a-c9a0-4d09-84fc-09e5c246d070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6ef92cad-175f-458f-9254-bd0a00ac5056 tempest-VolumesTransfersTest-1326856937 None] Created volume successfully. Jul 10 05:58:41 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 1073741824" returned: 0 in 0.810s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:41 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 Jul 10 05:58:41 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:42 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321" returned: 0 in 0.640s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1035302438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b27a0f6-d51c-44e0-af4b-4867ba08b948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de68037e464d3389c9d43880030d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:40Z,use_quota=True,user_id='0abfd57d19814de3b41dfb40d56c77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Creating volume 9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:58:42 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea94fb7f-1a2f-4292-a0e5-3fea127944a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a1ac7f-8816-49ad-a04b-31b82b695321', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:42 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 1073741824 Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fdce90-d055-4496-9995-6d2ca4b9398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:42 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:42 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Volume volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 (a5a1ac7f-8816-49ad-a04b-31b82b695321): created successfully Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fdce90-d055-4496-9995-6d2ca4b9398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Flow 'volume_create_manager' (90d42191-f1fb-4de2-8d64-2c4627693b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:42 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-40adf118-f24d-4b36-b79c-e3262ac7e36e tempest-VolumesTransfersTest-798847334 None] Transfer volume completed successfully. Jul 10 05:58:42 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-42859965-5c61-4690-9a83-222764618cdf tempest-VolumesSnapshotListTestJSON-1216247136 None] Created volume successfully. Jul 10 05:58:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:43 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 1073741824" returned: 0 in 0.851s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:43 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:58:43 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Acquiring lock "cinder-709ade77-b989-4e91-85ee-f4fdebf4c7a6-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Lock "cinder-709ade77-b989-4e91-85ee-f4fdebf4c7a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Acquiring lock "cinder-quobyte-709ade77-b989-4e91-85ee-f4fdebf4c7a6" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Lock "cinder-quobyte-709ade77-b989-4e91-85ee-f4fdebf4c7a6" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbce969-a02b-4fb4-9c45-c0284f2eceb7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:43 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 Jul 10 05:58:43 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:44 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.740s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.311s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efb876a-316d-4e88-aa51-4f98c58d3f37]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b666dd-3475-478d-871b-fc0369e2d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a8124a-0e33-4523-ad3c-ba162f173787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Volume volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 (9b27a0f6-d51c-44e0-af4b-4867ba08b948): created successfully Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a8124a-0e33-4523-ad3c-ba162f173787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Flow 'volume_create_manager' (f1b54454-3508-40d3-a6c9-f82004332306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:44 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:44 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-43aeaf0c-c374-4eb5-a32b-600fea755cb4 tempest-SnapshotDependencyTests-1833281369 None] Created volume successfully. Jul 10 05:58:44 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:44 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6 Jul 10 05:58:44 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:44 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecacb31-aaab-4882-9c60-6b9ba7cac4b7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:45 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:45 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:45 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-709ade77-b989-4e91-85ee-f4fdebf4c7a6" returned: 0 in 0.668s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Lock "cinder-quobyte-709ade77-b989-4e91-85ee-f4fdebf4c7a6" released by "delete_volume" :: held 1.517s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Created reservations ['363c2f5d-7e39-4c36-9139-3d3ce54a08e3', 'a7b9d611-6d83-467d-8a0f-7e726b5676e8', '54af074a-bb42-44fd-8196-84117066526a', 'bb3269c4-180d-419f-870a-53559bb463f3'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:45 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:45 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:45 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:45 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img Jul 10 05:58:45 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:45 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.653s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Deleted volume successfully. Jul 10 05:58:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4010dc1b-0ac6-456e-82cb-439a31a20dbc tempest-VolumesTransfersTest-570953362 None] Lock "cinder-709ade77-b989-4e91-85ee-f4fdebf4c7a6-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Flow 'volume_create_manager' (7505d776-6748-4a90-a602-47b1f59e9ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d43884-0aa8-42a9-9a1a-b8587fc7d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d43884-0aa8-42a9-9a1a-b8587fc7d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1615602517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1684ede6-ee6a-4a20-b17a-b50dab4e2e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b57edaaed044c6a4b85bcd41b89f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:46Z,use_quota=True,user_id='18b54dd3ae214001970e3896bc8c7990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9cf6e2-aee2-4f6b-9ca5-8e1134030d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9cf6e2-aee2-4f6b-9ca5-8e1134030d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018424d1-0196-4c19-8c66-0aad658f85ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018424d1-0196-4c19-8c66-0aad658f85ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1684ede6-ee6a-4a20-b17a-b50dab4e2e10', 'volume_name': 'volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b71dc5a-2a8c-4fcd-b878-caf6e0fc70c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b71dc5a-2a8c-4fcd-b878-caf6e0fc70c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d86c466-bc52-4211-a1bc-453ed6bdea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:58:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Volume 1684ede6-ee6a-4a20-b17a-b50dab4e2e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10', 'volume_size': 1} Jul 10 05:58:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:49 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img" returned: 0 in 4.261s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32688ca-84d5-41c1-b74c-821dc32da741]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:50 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:50 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:50 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.909s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:50 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:58:50 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Converted 1024.00 MB image at 240.24 MB/s Jul 10 05:58:50 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] 1866638c-e22d-4b0e-acfb-482def1602c1 was raw, converting to qcow2 {{(pid=87449) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1178}} Jul 10 05:58:50 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd64137a-45c9-48f0-bea7-a30eba434519]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:51 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img Jul 10 05:58:51 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:51 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img" returned: 0 in 0.705s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:51 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img Jul 10 05:58:51 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:52 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img" returned: 1 in 0.708s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img /opt/stack/data/cinder/conversion/vol_upload_5mgampcd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:52 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img /opt/stack/data/cinder/conversion/vol_upload_5mgampcd Jul 10 05:58:52 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:52 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img /opt/stack/data/cinder/conversion/vol_upload_5mgampcd" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Image conversion details: src /opt/stack/data/cinder/conversion/e55c911a-a974-41d1-8514-6bd4d9225f8c.temp_image.1866638c-e22d-4b0e-acfb-482def1602c181dk09wy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5mgampcd {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:58:52 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46c3cd-72c7-4e1a-aea0-407e3c9c4b73]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5mgampcd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:53 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5mgampcd Jul 10 05:58:53 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:53 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5mgampcd" returned: 0 in 0.698s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.837s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Uploaded volume to glance image-id: 1866638c-e22d-4b0e-acfb-482def1602c1. {{(pid=87449) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 05:58:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.071s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Creating offline snapshot 3c186299-37d0-47ce-a92c-36eafc3d2f6e of volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:58:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e4a20583-939c-4e39-bde8-c75db958b79c tempest-VolumesActionsTest-15700650 None] Copy volume to image completed successfully. Jul 10 05:58:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b16e2-5fc4-4265-a66f-b688569dc805]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:55 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 Jul 10 05:58:55 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:55 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321" returned: 0 in 0.739s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:55 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e 1G Jul 10 05:58:55 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Acquiring lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Acquiring lock "cinder-quobyte-e55c911a-a974-41d1-8514-6bd4d9225f8c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Lock "cinder-quobyte-e55c911a-a974-41d1-8514-6bd4d9225f8c" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b113102d-f977-430d-866f-084cdc3639f8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:56 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:56 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:56 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e 1G" returned: 0 in 0.841s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:56 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:58:56 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:56 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.757s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:56 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c Jul 10 05:58:56 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:57 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 0.748s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:57 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e is being set with open permissions: ugo+rw Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:57 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:58:57 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:57 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e55c911a-a974-41d1-8514-6bd4d9225f8c" returned: 0 in 0.710s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Lock "cinder-quobyte-e55c911a-a974-41d1-8514-6bd4d9225f8c" released by "delete_volume" :: held 1.503s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Created reservations ['cf502120-e8b8-493d-a036-902d729f8546', 'ad3c7318-118f-4c3b-9dd4-966aef3c17f4', 'ca6f480f-2fc6-443a-8246-b38bd0a5a34f', '57067201-9bee-41ab-825c-c2f5da35ea78'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:57 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:58:57 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:57 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 0.649s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:57 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info Jul 10 05:58:57 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:58 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.665s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:58 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:58:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Deleted volume successfully. Jul 10 05:58:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4b6b0991-0043-4f64-8772-526fdbc21476 tempest-VolumesActionsTest-15700650 None] Lock "cinder-e55c911a-a974-41d1-8514-6bd4d9225f8c-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:58:58 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info" returned: 0 in 0.675s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:58 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info is being set with open permissions: ugo+rw Jul 10 05:58:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:58 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info Jul 10 05:58:58 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:59 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.info" returned: 0 in 0.653s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.257s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Creating offline snapshot 36317b7c-3d35-4658-b1c5-8893dcc40ec8 of volume 9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:58:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9e2bf7ab-7fc2-4435-a0d1-cc3cf15481ca tempest-VolumesSnapshotListTestJSON-1216247136 None] Create snapshot completed successfully Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef5925b-222a-4092-9322-01eb1fce0431]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:58:59 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:58:59 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:58:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:00 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.809s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:00 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 1G Jul 10 05:59:00 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:01 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 1G" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:01 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 Jul 10 05:59:01 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:01 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8" returned: 0 in 0.745s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:01 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 is being set with open permissions: ugo+rw Jul 10 05:59:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:01 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 Jul 10 05:59:01 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:02 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8" returned: 0 in 0.700s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:02 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info Jul 10 05:59:02 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:03 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info" returned: 0 in 0.695s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:03 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info is being set with open permissions: ugo+rw Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:03 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info Jul 10 05:59:03 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:03 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.info" returned: 0 in 0.655s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.577s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.431s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1615602517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1684ede6-ee6a-4a20-b17a-b50dab4e2e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b57edaaed044c6a4b85bcd41b89f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:58:46Z,use_quota=True,user_id='18b54dd3ae214001970e3896bc8c7990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Creating volume 1684ede6-ee6a-4a20-b17a-b50dab4e2e10 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:03 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:03 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 1073741824 Jul 10 05:59:03 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dfd4f0fd-aee1-4464-bcf8-38056f60b276 tempest-SnapshotDependencyTests-1833281369 None] Create snapshot completed successfully Jul 10 05:59:04 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 1073741824" returned: 0 in 0.843s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:04 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 Jul 10 05:59:04 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Flow 'volume_create_manager' (9dc66af5-0cae-4732-aa4c-f67821010694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2557004-c736-4aef-a19d-aa8ab816a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2557004-c736-4aef-a19d-aa8ab816a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1505558871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b10fb4c-17e2-49c7-8145-813978df2cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be4b84f19c4161834ea4eacc638064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:05Z,use_quota=True,user_id='b7ccf6c7235044e79eafcba5d76e7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aee7368-15c4-4b95-8d2e-d35667bb8169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aee7368-15c4-4b95-8d2e-d35667bb8169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36ae310-5245-4a22-8c9a-15c132420112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36ae310-5245-4a22-8c9a-15c132420112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b10fb4c-17e2-49c7-8145-813978df2cda', 'volume_name': 'volume-8b10fb4c-17e2-49c7-8145-813978df2cda', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149e46c5-ee65-48c4-88d0-5f0f9c1e5f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149e46c5-ee65-48c4-88d0-5f0f9c1e5f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a52e25-9735-4685-8df9-e5318db12a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Volume 8b10fb4c-17e2-49c7-8145-813978df2cda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b10fb4c-17e2-49c7-8145-813978df2cda', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Trying to clone 8b10fb4c-17e2-49c7-8145-813978df2cda from image b4e08d22-7293-452f-a208-7a340b669863 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 05:59:05 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10" returned: 0 in 0.733s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.763s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d86c466-bc52-4211-a1bc-453ed6bdea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92059b8-f844-49a0-9497-c31c6eec69cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Volume volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 (1684ede6-ee6a-4a20-b17a-b50dab4e2e10): created successfully Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92059b8-f844-49a0-9497-c31c6eec69cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Flow 'volume_create_manager' (7505d776-6748-4a90-a602-47b1f59e9ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 05:59:05 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Image download 20.69 MB at 20.69 MB/s Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Creating offline snapshot 42c93212-1f69-4a28-8388-79b8f1e793bd of volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Flow 'volume_create_manager' (b9c30596-cdc6-4b70-81bc-b166ff4a4fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f479ac-9434-458a-b754-a44756fe44d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[df36b895-6554-47ec-99cf-d6b3db1f87e1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9b8dde30-8bd0-4bef-959b-903d3066445c tempest-VolumesTransfersTest-1326856937 None] Created volume successfully. Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d905e-be0b-486e-9a3e-521222ae7a93]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f479ac-9434-458a-b754-a44756fe44d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de254a5-8134-44af-9e4d-bf045031072c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7de68037e464d3389c9d43880030d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36317b7c-3d35-4658-b1c5-8893dcc40ec8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:05Z,use_quota=True,user_id='0abfd57d19814de3b41dfb40d56c77f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e28b2c-acc2-4b4d-a1aa-bc047d0316ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e28b2c-acc2-4b4d-a1aa-bc047d0316ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4823ebdc-c721-4bbf-9313-47d7ead738bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4823ebdc-c721-4bbf-9313-47d7ead738bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8de254a5-8134-44af-9e4d-bf045031072c', 'volume_name': 'volume-8de254a5-8134-44af-9e4d-bf045031072c', 'volume_size': 1, 'snapshot_id': '36317b7c-3d35-4658-b1c5-8893dcc40ec8'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948b7587-e0fc-4c3c-a317-c23a607c6b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948b7587-e0fc-4c3c-a317-c23a607c6b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc1abbe-16e8-42aa-a50b-dc4cc762ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Volume 8de254a5-8134-44af-9e4d-bf045031072c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8de254a5-8134-44af-9e4d-bf045031072c', 'volume_size': 1, 'snapshot_id': '36317b7c-3d35-4658-b1c5-8893dcc40ec8'} Jul 10 05:59:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:06 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:59:06 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:06 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD Jul 10 05:59:06 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:06 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 0.788s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:06 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD" returned: 0 in 0.775s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 is fetched for user b7ccf6c7235044e79eafcba5d76e7e81. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 05:59:06 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd 1G Jul 10 05:59:06 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8838495-c87d-43a7-b77a-be878c0f5f0c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:06 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD Jul 10 05:59:06 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Acquiring lock "cinder-1684ede6-ee6a-4a20-b17a-b50dab4e2e10-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Lock "cinder-1684ede6-ee6a-4a20-b17a-b50dab4e2e10-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Acquiring lock "cinder-quobyte-1684ede6-ee6a-4a20-b17a-b50dab4e2e10" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Lock "cinder-quobyte-1684ede6-ee6a-4a20-b17a-b50dab4e2e10" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a2835-6af4-4593-890f-40003981f4df]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:07 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 Jul 10 05:59:07 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:07 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:07 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd 1G" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:07 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:07 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:07 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10" returned: 0 in 0.764s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:07 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10 Jul 10 05:59:07 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:08 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 0.723s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:08 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd is being set with open permissions: ugo+rw Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:08 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:08 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:08 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1684ede6-ee6a-4a20-b17a-b50dab4e2e10" returned: 0 in 0.640s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Lock "cinder-quobyte-1684ede6-ee6a-4a20-b17a-b50dab4e2e10" released by "delete_volume" :: held 1.453s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Created reservations ['58c86d68-8d6d-4179-b5be-cc162e7ace22', '7228a32a-25d0-483b-8fb1-c30fba2616ed', 'cbd9f0a3-7faf-4f82-bf55-42b36f7a5d85', '5456c6b1-e019-4635-b942-14044ae66f05'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:08 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:08 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:08 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 0.676s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.470s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.020s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-quobyte-36317b7c-3d35-4658-b1c5-8893dcc40ec8-8de254a5-8134-44af-9e4d-bf045031072c" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-36317b7c-3d35-4658-b1c5-8893dcc40ec8-8de254a5-8134-44af-9e4d-bf045031072c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Creating volume 8de254a5-8134-44af-9e4d-bf045031072c from snapshot 36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-quobyte-8de254a5-8134-44af-9e4d-bf045031072c" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d86bb35e-3b6e-4e61-a37d-64213a4bdacf tempest-VolumesSnapshotListTestJSON-1216247136 None] Create snapshot completed successfully Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-8de254a5-8134-44af-9e4d-bf045031072c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] snapshot: 36317b7c-3d35-4658-b1c5-8893dcc40ec8, volume: 8de254a5-8134-44af-9e4d-bf045031072c, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[857a5dd6-e44f-4e61-9f41-b5e46db32647]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:09 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 Jul 10 05:59:09 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:09 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.856s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Deleted volume successfully. Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0331fa42-22ce-4931-8b37-e3c0310650ab tempest-VolumesTransfersTest-570953362 None] Lock "cinder-1684ede6-ee6a-4a20-b17a-b50dab4e2e10-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:09 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8" returned: 0 in 0.835s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[193d944d-7234-475d-9468-9be72c8cc106]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:10 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:59:10 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:10 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:10 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 05:59:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:10 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c Jul 10 05:59:10 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:16 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c" returned: 0 in 5.345s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:16 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7d83e-d930-4628-b656-3e0249260b5d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:16 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:59:16 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:17 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.960s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:59:17 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Converted 1024.00 MB image at 191.52 MB/s Jul 10 05:59:17 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c is being set with open permissions: ugo+rw Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:17 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c Jul 10 05:59:17 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:17 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c" returned: 0 in 0.660s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-8de254a5-8134-44af-9e4d-bf045031072c" released by "_copy_volume_from_snapshot" :: held 8.729s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-36317b7c-3d35-4658-b1c5-8893dcc40ec8-8de254a5-8134-44af-9e4d-bf045031072c" released by "_create_volume_from_snapshot" :: held 8.769s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.793s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.239s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1505558871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b10fb4c-17e2-49c7-8145-813978df2cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be4b84f19c4161834ea4eacc638064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:05Z,use_quota=True,user_id='b7ccf6c7235044e79eafcba5d76e7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Creating volume 8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:17 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:17 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 1073741824 Jul 10 05:59:17 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc1abbe-16e8-42aa-a50b-dc4cc762ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de254a5-8134-44af-9e4d-bf045031072c', 'volume_size': 1, 'snapshot_id': '36317b7c-3d35-4658-b1c5-8893dcc40ec8'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af24cca-63a7-4306-a1a9-fcdf361bc832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Flow 'volume_create_manager' (1d51e363-af6d-45f2-ad2d-b23569bad547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b15ee7-9a37-4bf1-9891-20ccce3b0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b15ee7-9a37-4bf1-9891-20ccce3b0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1353426393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcb097c-031b-404a-8994-12dea3e6493f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e7fa1405740eba1a83cea2f4095f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:18Z,use_quota=True,user_id='a151d66e1be247aba3e50b79baf43a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01fa77f-b46f-4457-98b8-e2e2e2b6c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01fa77f-b46f-4457-98b8-e2e2e2b6c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa3910e-ec54-4036-9d67-1da7dd2511a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa3910e-ec54-4036-9d67-1da7dd2511a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcb097c-031b-404a-8994-12dea3e6493f', 'volume_name': 'volume-dbcb097c-031b-404a-8994-12dea3e6493f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e163ce-7d73-4535-aa3c-6de08fe6e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e163ce-7d73-4535-aa3c-6de08fe6e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a914d-cbbc-46d7-bcf6-23e26cbefe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:17 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Volume dbcb097c-031b-404a-8994-12dea3e6493f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcb097c-031b-404a-8994-12dea3e6493f', 'volume_size': 1} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:17 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Volume volume-8de254a5-8134-44af-9e4d-bf045031072c (8de254a5-8134-44af-9e4d-bf045031072c): created successfully Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af24cca-63a7-4306-a1a9-fcdf361bc832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Flow 'volume_create_manager' (b9c30596-cdc6-4b70-81bc-b166ff4a4fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d1b2c04d-dfd3-425e-aefb-8cbed907bbf6 tempest-SnapshotDependencyTests-1833281369 None] Created volume successfully. Jul 10 05:59:18 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-36317b7c-3d35-4658-b1c5-8893dcc40ec8-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 1073741824" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-36317b7c-3d35-4658-b1c5-8893dcc40ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-quobyte-9b27a0f6-d51c-44e0-af4b-4867ba08b948" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-9b27a0f6-d51c-44e0-af4b-4867ba08b948" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-quobyte-36317b7c-3d35-4658-b1c5-8893dcc40ec8" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:18 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:18 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-36317b7c-3d35-4658-b1c5-8893dcc40ec8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Deleting offline snapshot 36317b7c-3d35-4658-b1c5-8893dcc40ec8 of volume 9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] snapshot_file for this snap is: volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27811af-7104-47ca-ab9e-f3194686cf75]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:18 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 Jul 10 05:59:18 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:19 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 0 in 0.626s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.845s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Creating offline snapshot aa911960-6393-4f11-94da-8dbd8d4bf873 of volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Attempting download of b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume 8b10fb4c-17e2-49c7-8145-813978df2cda. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe164be9-e1d8-403f-b9b7-80550f6cf689]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1982387-3386-45e4-9d9b-f648da1a767d]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:19 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:19 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:19 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:19 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi Jul 10 05:59:19 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[faecb395-aff6-41e0-aea8-e82e3425263b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:19 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:59:19 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:20 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:20 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 0.812s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:20 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 1G Jul 10 05:59:20 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:20 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi Jul 10 05:59:20 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:20 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.813s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:20 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 Jul 10 05:59:20 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:20 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi" returned: 1 in 0.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_4nz4jipi' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee86c8-8a50-4ce6-8ea4-50f64708737d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:20 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD Jul 10 05:59:20 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:21 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 1G" returned: 0 in 0.895s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:21 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 Jul 10 05:59:21 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:21 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8" returned: 0 in 0.794s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:21 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8 Jul 10 05:59:21 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:21 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:21 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] b4e08d22-7293-452f-a208-7a340b669863 was qcow2, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:21 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:21 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873" returned: 0 in 0.726s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:21 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 is being set with open permissions: ugo+rw Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:21 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 Jul 10 05:59:21 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:21 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948.36317b7c-3d35-4658-b1c5-8893dcc40ec8" returned: 0 in 0.709s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-36317b7c-3d35-4658-b1c5-8893dcc40ec8" released by "_delete_snapshot" :: held 3.197s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-9b27a0f6-d51c-44e0-af4b-4867ba08b948" released by "delete_snapshot" :: held 3.225s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:21 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Created reservations ['b6d2fe05-74e4-4ecd-a305-aee297fce491', '9ed4f1e0-17a0-4618-a689-8fffc5ce88e6', '106513ab-821d-4d94-a8e2-66bccdccf320', '4e979438-60d7-4fac-ad28-560cf44f6c98'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Delete snapshot completed successfully. Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-771451a4-775d-4729-8278-86fb8104dac1 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-36317b7c-3d35-4658-b1c5-8893dcc40ec8-delete_snapshot" released by "delete_snapshot" :: held 3.384s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:22 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873" returned: 0 in 0.740s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1353426393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcb097c-031b-404a-8994-12dea3e6493f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e7fa1405740eba1a83cea2f4095f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:18Z,use_quota=True,user_id='a151d66e1be247aba3e50b79baf43a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Creating volume dbcb097c-031b-404a-8994-12dea3e6493f {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:22 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:22 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f 1073741824 Jul 10 05:59:22 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-de67c7ad-5eb4-4b9b-a5f5-4bffc9028e49 tempest-VolumesSnapshotListTestJSON-1216247136 None] Create snapshot completed successfully Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-9b27a0f6-d51c-44e0-af4b-4867ba08b948-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-9b27a0f6-d51c-44e0-af4b-4867ba08b948-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-quobyte-9b27a0f6-d51c-44e0-af4b-4867ba08b948" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-9b27a0f6-d51c-44e0-af4b-4867ba08b948" acquired by "delete_volume" :: waited 0.040s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[19354f6a-dfd5-48a1-9673-5b5826f6e156]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:23 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:59:23 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:23 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f 1073741824" returned: 0 in 0.994s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:23 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f Jul 10 05:59:23 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:23 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 0 in 2.164s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_nk5uqos_devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 05:59:23 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Converted 112.00 MB image at 51.73 MB/s Jul 10 05:59:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:23 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 1G Jul 10 05:59:23 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:24 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.984s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:24 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948 Jul 10 05:59:24 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-aa911960-6393-4f11-94da-8dbd8d4bf873-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-aa911960-6393-4f11-94da-8dbd8d4bf873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-aa911960-6393-4f11-94da-8dbd8d4bf873" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-aa911960-6393-4f11-94da-8dbd8d4bf873" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Deleting offline snapshot aa911960-6393-4f11-94da-8dbd8d4bf873 of volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] snapshot_file for this snap is: volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[81765aa0-72b7-45e9-8341-4590e22d9a38]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:24 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 Jul 10 05:59:24 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:24 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f" returned: 0 in 0.823s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a914d-cbbc-46d7-bcf6-23e26cbefe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcb097c-031b-404a-8994-12dea3e6493f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecfac1b-e8a7-4c8b-ae6d-3608de3dd86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Volume volume-dbcb097c-031b-404a-8994-12dea3e6493f (dbcb097c-031b-404a-8994-12dea3e6493f): created successfully Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecfac1b-e8a7-4c8b-ae6d-3608de3dd86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Flow 'volume_create_manager' (1d51e363-af6d-45f2-ad2d-b23569bad547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-db926325-30de-4870-addb-fd82c51f004f tempest-VolumesTransfersV357Test-111139186 None] Created volume successfully. Jul 10 05:59:24 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 1G" returned: 0 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[879564db-10f7-4855-9e10-5705f7be7074]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:24 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:24 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:24 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9b27a0f6-d51c-44e0-af4b-4867ba08b948" returned: 0 in 0.723s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-9b27a0f6-d51c-44e0-af4b-4867ba08b948" released by "delete_volume" :: held 1.813s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Created reservations ['9a4abfed-7643-4085-a245-6ce116799ea8', '058ad8ca-a054-4e87-81a3-444efe6aec08', 'ff00a4a6-9e4d-4e36-9133-52dd5cddfa7c', 'd6726c65-e1c0-492f-96c8-f6822e85c5ea'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:24 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:24 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:25 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873" returned: 0 in 0.855s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd248d60-c7c3-432c-8496-d91a23142281]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:25 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:25 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-8de254a5-8134-44af-9e4d-bf045031072c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-8de254a5-8134-44af-9e4d-bf045031072c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "cinder-quobyte-8de254a5-8134-44af-9e4d-bf045031072c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-8de254a5-8134-44af-9e4d-bf045031072c" acquired by "delete_volume" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[188fb021-5cf8-46e3-8386-d2d77e994113]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:25 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c Jul 10 05:59:25 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:25 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.744s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Deleted volume successfully. Jul 10 05:59:25 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 0 in 1.028s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-61c622f8-fb5c-41b3-9e8c-088a09e5c0f5 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-9b27a0f6-d51c-44e0-af4b-4867ba08b948-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:25 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:25 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-44ed8718-ae9e-4961-8c44-6b4cbf59b74d tempest-VolumesTransfersV357Test-123093012 None] Transfer volume completed successfully. Jul 10 05:59:26 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 1.076s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:26 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 Jul 10 05:59:26 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:26 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c" returned: 0 in 0.876s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:26 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c Jul 10 05:59:26 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:26 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 1 in 0.861s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Downloaded image b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume 8b10fb4c-17e2-49c7-8145-813978df2cda successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 for user b7ccf6c7235044e79eafcba5d76e7e81 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Marking volume 8b10fb4c-17e2-49c7-8145-813978df2cda as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Copying metadata from image b4e08d22-7293-452f-a208-7a340b669863 to 8b10fb4c-17e2-49c7-8145-813978df2cda. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Creating volume glance metadata for volume 8b10fb4c-17e2-49c7-8145-813978df2cda backed by image b4e08d22-7293-452f-a208-7a340b669863 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a52e25-9735-4685-8df9-e5318db12a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b10fb4c-17e2-49c7-8145-813978df2cda', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1172bd6b-7168-47b2-a02b-557e941c1fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Volume volume-8b10fb4c-17e2-49c7-8145-813978df2cda (8b10fb4c-17e2-49c7-8145-813978df2cda): created successfully Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1172bd6b-7168-47b2-a02b-557e941c1fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Flow 'volume_create_manager' (9dc66af5-0cae-4732-aa4c-f67821010694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f9947750-4359-4cf0-9f25-ed749fce4c7b tempest-VolumesExtendTest-1422170550 None] Created volume successfully. Jul 10 05:59:26 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8de254a5-8134-44af-9e4d-bf045031072c" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-quobyte-8de254a5-8134-44af-9e4d-bf045031072c" released by "delete_volume" :: held 1.619s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Created reservations ['9a61f078-af88-44d2-913d-0a2d46c2413a', '256a4326-f465-4830-a109-8a793f1f59ae', '9b75dc6a-3e0a-45ee-bdbb-0d721c83f160', 'cf38ea03-0498-42e2-878c-88db0327e27c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:27 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873" returned: 0 in 0.919s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:27 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873 Jul 10 05:59:27 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Acquiring lock "cinder-dbcb097c-031b-404a-8994-12dea3e6493f-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-dbcb097c-031b-404a-8994-12dea3e6493f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:27 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:27 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Acquiring lock "cinder-quobyte-dbcb097c-031b-404a-8994-12dea3e6493f" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-quobyte-dbcb097c-031b-404a-8994-12dea3e6493f" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59df67af-5892-4032-a78f-a92bf276799a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:27 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f Jul 10 05:59:27 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:27 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.aa911960-6393-4f11-94da-8dbd8d4bf873" returned: 0 in 0.784s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-aa911960-6393-4f11-94da-8dbd8d4bf873" released by "_delete_snapshot" :: held 3.745s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" released by "delete_snapshot" :: held 3.777s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:27 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.810s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Deleted volume successfully. Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1f3b1135-92af-4129-9cda-3bfcb6c03ba3 tempest-SnapshotDependencyTests-1833281369 None] Lock "cinder-8de254a5-8134-44af-9e4d-bf045031072c-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Created reservations ['6fb1f720-84f0-47a1-9e01-442d8c97feeb', 'abf3f15d-17da-4be7-a950-bc6fc693fe8b', '26797f3e-9132-414c-850e-52f78c0da223', 'b57734f1-31c7-4661-b0d9-49f4278be603'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ab722-fba0-4132-bfff-9680a541aa33]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Delete snapshot completed successfully. Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8d461277-9f98-4dfa-b1cf-30f1ebe0ab5b tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-aa911960-6393-4f11-94da-8dbd8d4bf873-delete_snapshot" released by "delete_snapshot" :: held 4.068s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:28 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f" returned: 0 in 0.959s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:28 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:28 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:28 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f Jul 10 05:59:28 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-42c93212-1f69-4a28-8388-79b8f1e793bd-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-42c93212-1f69-4a28-8388-79b8f1e793bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-42c93212-1f69-4a28-8388-79b8f1e793bd" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-42c93212-1f69-4a28-8388-79b8f1e793bd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Deleting offline snapshot 42c93212-1f69-4a28-8388-79b8f1e793bd of volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] snapshot_file for this snap is: volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e464004b-0add-4c4f-9fab-c5d94b7918b4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:28 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:28 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:28 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:28 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:29 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 0 in 0.900s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:29 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-dbcb097c-031b-404a-8994-12dea3e6493f" returned: 0 in 0.891s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-quobyte-dbcb097c-031b-404a-8994-12dea3e6493f" released by "delete_volume" :: held 1.909s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:29 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:29 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Created reservations ['c0ec6075-0ee1-4ed4-be73-ab72ea86c2d0', '47a3ebe9-3bf6-45cd-bf0e-ea491758f623', '6a92a1af-48c7-4cc8-bee4-1931d9c483fb', '865c8bf8-449b-4f07-a4d3-cfa19cc27b88'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:29 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:29 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:29 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 1.126s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[798a2df4-dbd0-480b-8132-9ca1c1315db4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:30 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:59:30 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:30 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.239s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:30 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Flow 'volume_create_manager' (372e900b-8937-4376-9e83-e8e73f3dd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e77c3-686b-402f-9bac-84770ab43a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 1 in 1.274s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 2G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e77c3-686b-402f-9bac-84770ab43a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2063499550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e71bca0-d852-4037-b404-a9cf038a2105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e7fa1405740eba1a83cea2f4095f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:30Z,use_quota=True,user_id='a151d66e1be247aba3e50b79baf43a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a0e707-5d41-4cf4-b655-b7b7a70372ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a0e707-5d41-4cf4-b655-b7b7a70372ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42268ab0-fdda-4c48-9778-851f4440dc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42268ab0-fdda-4c48-9778-851f4440dc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e71bca0-d852-4037-b404-a9cf038a2105', 'volume_name': 'volume-3e71bca0-d852-4037-b404-a9cf038a2105', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5404de81-f325-4fc1-8c89-f274eb002a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5404de81-f325-4fc1-8c89-f274eb002a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15d1801-accd-405e-9ae5-1261d3082bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:30 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Volume 3e71bca0-d852-4037-b404-a9cf038a2105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e71bca0-d852-4037-b404-a9cf038a2105', 'volume_size': 1} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda 2G" returned: 0 in 0.092s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.328s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2063499550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e71bca0-d852-4037-b404-a9cf038a2105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25e7fa1405740eba1a83cea2f4095f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:30Z,use_quota=True,user_id='a151d66e1be247aba3e50b79baf43a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Creating volume 3e71bca0-d852-4037-b404-a9cf038a2105 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:30 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:30 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 1073741824 Jul 10 05:59:30 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:30 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9a82c427-d458-4d27-b03a-dc08ae581173 tempest-VolumesExtendTest-1422170550 None] Extend volume completed successfully. Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.155s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Deleted volume successfully. Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-83438a97-1aa5-4fe4-ac6b-9fbdbd5d0d26 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-dbcb097c-031b-404a-8994-12dea3e6493f-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:30 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 1.108s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:30 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:30 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:31 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 1073741824" returned: 0 in 1.149s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:31 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 Jul 10 05:59:31 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-8b10fb4c-17e2-49c7-8145-813978df2cda-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-8b10fb4c-17e2-49c7-8145-813978df2cda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-quobyte-8b10fb4c-17e2-49c7-8145-813978df2cda" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-8b10fb4c-17e2-49c7-8145-813978df2cda" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af1247-cbcc-4989-a831-37b16faeb3fa]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:31 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 1.014s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:31 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:31 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:31 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd Jul 10 05:59:31 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:32 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105" returned: 0 in 0.847s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15d1801-accd-405e-9ae5-1261d3082bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e71bca0-d852-4037-b404-a9cf038a2105', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec05eee-7166-46e4-8188-319943e706c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:32 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Volume volume-3e71bca0-d852-4037-b404-a9cf038a2105 (3e71bca0-d852-4037-b404-a9cf038a2105): created successfully Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec05eee-7166-46e4-8188-319943e706c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Flow 'volume_create_manager' (372e900b-8937-4376-9e83-e8e73f3dd017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b23ea48c-c4ef-4325-990b-25d40f54402d tempest-VolumesTransfersV357Test-111139186 None] Created volume successfully. Jul 10 05:59:32 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.42c93212-1f69-4a28-8388-79b8f1e793bd" returned: 0 in 0.764s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-42c93212-1f69-4a28-8388-79b8f1e793bd" released by "_delete_snapshot" :: held 4.148s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" released by "delete_snapshot" :: held 4.184s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:32 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 0 in 0.948s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Created reservations ['a9d76b8e-cfd0-4976-86fc-a5ff5183a912', '7ead2e29-cca4-4f13-b385-879adac6ac03', 'c0c60477-61de-47bb-b853-8294c748b469', '03f7d33d-a654-4bdd-a868-a3e19c223060'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Delete snapshot completed successfully. Jul 10 05:59:32 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:32 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-21c4ac04-1aee-4997-afdb-c8d3c210b81d tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-42c93212-1f69-4a28-8388-79b8f1e793bd-delete_snapshot" released by "delete_snapshot" :: held 4.392s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:33 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 1 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:33 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda Jul 10 05:59:33 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Acquiring lock "cinder-3e71bca0-d852-4037-b404-a9cf038a2105-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-3e71bca0-d852-4037-b404-a9cf038a2105-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=98,cinder:SELECT=87,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=84,cinder:UPDATE=98,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Acquiring lock "cinder-quobyte-3e71bca0-d852-4037-b404-a9cf038a2105" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-quobyte-3e71bca0-d852-4037-b404-a9cf038a2105" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[875568e2-9e38-42bf-93ce-e2cfa76a8326]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-3c186299-37d0-47ce-a92c-36eafc3d2f6e-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:33 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 Jul 10 05:59:33 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-3c186299-37d0-47ce-a92c-36eafc3d2f6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-3c186299-37d0-47ce-a92c-36eafc3d2f6e" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-3c186299-37d0-47ce-a92c-36eafc3d2f6e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Deleting offline snapshot 3c186299-37d0-47ce-a92c-36eafc3d2f6e of volume a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] snapshot_file for this snap is: volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[34efe669-9ede-4605-892f-27335caef206]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:34 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:59:34 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:34 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b10fb4c-17e2-49c7-8145-813978df2cda" returned: 0 in 0.821s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-8b10fb4c-17e2-49c7-8145-813978df2cda" released by "delete_volume" :: held 2.649s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Created reservations ['de9c5959-c2e6-43df-83ff-25ff9ff82d5a', '721290cd-e598-4734-9003-e378f70af808', 'ff358224-af6a-4980-a880-3946af6a4c30', '0ffd0370-5494-4dcf-8826-4c3ab99039da'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:34 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:34 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:34 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105" returned: 0 in 0.970s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:34 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105 Jul 10 05:59:34 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:34 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 0.929s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1ac7f-8816-49ad-a04b-31b82b695321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d966b9a3-4791-4cee-b677-45f7e75e6764]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:35 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 Jul 10 05:59:35 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:35 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.941s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Deleted volume successfully. Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c27224ca-8756-49ef-a98a-f73e195b3853 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-8b10fb4c-17e2-49c7-8145-813978df2cda-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:35 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e71bca0-d852-4037-b404-a9cf038a2105" returned: 0 in 1.076s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-quobyte-3e71bca0-d852-4037-b404-a9cf038a2105" released by "delete_volume" :: held 2.101s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Flow 'volume_create_manager' (764809d1-7a96-4ef3-b99c-8e544cfcd122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169d0e06-da7c-4ea2-9b9f-69832a8cf379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169d0e06-da7c-4ea2-9b9f-69832a8cf379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1641568428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e2e197-1b04-49c3-bb0b-6577076603e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be4b84f19c4161834ea4eacc638064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:36Z,use_quota=True,user_id='b7ccf6c7235044e79eafcba5d76e7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9720f2d7-7da1-43da-b43f-a8b274b48591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9720f2d7-7da1-43da-b43f-a8b274b48591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff65f47-2bc3-4d81-b890-f62f7dd9916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff65f47-2bc3-4d81-b890-f62f7dd9916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e2e197-1b04-49c3-bb0b-6577076603e8', 'volume_name': 'volume-85e2e197-1b04-49c3-bb0b-6577076603e8', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e3e719-a402-4d13-91a8-e6305c5613a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e3e719-a402-4d13-91a8-e6305c5613a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6980014-0792-46c6-9e0a-fcdffe5b57dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:36 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Volume 85e2e197-1b04-49c3-bb0b-6577076603e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e2e197-1b04-49c3-bb0b-6577076603e8', 'volume_size': 1} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1641568428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e2e197-1b04-49c3-bb0b-6577076603e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85be4b84f19c4161834ea4eacc638064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:36Z,use_quota=True,user_id='b7ccf6c7235044e79eafcba5d76e7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Creating volume 85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:36 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:36 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321" returned: 0 in 1.034s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:36 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 1073741824 Jul 10 05:59:36 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Created reservations ['b6010a02-aac8-47d2-a699-86287c9b2a02', 'c6a3699d-a995-46eb-a0fe-41f4682d03ea', '7db908f4-8498-414b-90ed-557a5640fc7d', 'd7a58d84-bbed-4e27-9481-5379b906f69f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:36 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:59:36 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:36 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:36 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:37 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 0.984s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:37 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e Jul 10 05:59:37 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:37 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.925s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:37 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 1073741824" returned: 0 in 1.135s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Deleted volume successfully. Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-060576ef-e0fc-49d7-b884-1e18d9e5df56 tempest-VolumesTransfersV357Test-1816625862 None] Lock "cinder-3e71bca0-d852-4037-b404-a9cf038a2105-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:37 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 Jul 10 05:59:37 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:37 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321.3c186299-37d0-47ce-a92c-36eafc3d2f6e" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-3c186299-37d0-47ce-a92c-36eafc3d2f6e" released by "_delete_snapshot" :: held 3.867s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" released by "delete_snapshot" :: held 3.899s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:37 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Created reservations ['c24e271e-2037-4999-877e-2a2779fb7dbb', 'e716067b-4a4b-41d4-9d13-57220c2b53bd', 'c3f82f0c-ecfd-4ca8-a37a-17103b5575d0', '74920a11-6d54-4d61-830e-4d0bfa5d29d3'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Delete snapshot completed successfully. Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-93579aff-8db4-4440-9d35-2f5cfff37d5a tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-3c186299-37d0-47ce-a92c-36eafc3d2f6e-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:38 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8" returned: 0 in 0.853s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6980014-0792-46c6-9e0a-fcdffe5b57dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e2e197-1b04-49c3-bb0b-6577076603e8', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99233204-ec52-4a5f-a94f-a3b004195352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Volume volume-85e2e197-1b04-49c3-bb0b-6577076603e8 (85e2e197-1b04-49c3-bb0b-6577076603e8): created successfully Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99233204-ec52-4a5f-a94f-a3b004195352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Flow 'volume_create_manager' (764809d1-7a96-4ef3-b99c-8e544cfcd122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-420b74f6-01a7-4ba4-b2dc-a93f8fdca8c5 tempest-VolumesExtendTest-1422170550 None] Created volume successfully. Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-a5a1ac7f-8816-49ad-a04b-31b82b695321-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-a5a1ac7f-8816-49ad-a04b-31b82b695321-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fdbe74-5f29-4191-8379-1effec50d35b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:38 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 Jul 10 05:59:38 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:39 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:39 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321 Jul 10 05:59:39 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Creating offline snapshot c8d48900-53d6-4ec8-a5af-559d96aab67e of volume 85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be0cc69-8968-4087-8692-41f545b31fb7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:39 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 Jul 10 05:59:39 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:40 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a5a1ac7f-8816-49ad-a04b-31b82b695321" returned: 0 in 0.701s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-quobyte-a5a1ac7f-8816-49ad-a04b-31b82b695321" released by "delete_volume" :: held 1.686s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Created reservations ['01de8b4f-1c16-484a-9cfd-2784520df67c', '8ac4460c-24a8-4c55-8c67-98d6b73ee502', '5f335828-ae22-4826-86c6-6a357fad04a3', 'db5ae019-e226-4d41-b639-d8b96a6aa49c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:40 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:40 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:40 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8" returned: 0 in 0.815s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:40 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e 1G Jul 10 05:59:40 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:40 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.716s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Deleted volume successfully. Jul 10 05:59:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66b81c5d-86af-4281-ae36-16435be1d973 tempest-VolumesSnapshotListTestJSON-1216247136 None] Lock "cinder-a5a1ac7f-8816-49ad-a04b-31b82b695321-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:41 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e 1G" returned: 0 in 0.967s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e2e197-1b04-49c3-bb0b-6577076603e8 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:41 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e2e197-1b04-49c3-bb0b-6577076603e8 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e Jul 10 05:59:41 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:41 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e2e197-1b04-49c3-bb0b-6577076603e8 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:41 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e is being set with open permissions: ugo+rw Jul 10 05:59:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:42 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e Jul 10 05:59:42 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:42 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e" returned: 0 in 0.680s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:42 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info Jul 10 05:59:42 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:43 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info" returned: 0 in 0.706s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:43 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info is being set with open permissions: ugo+rw Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:43 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info Jul 10 05:59:43 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (41b47a4e-ae41-43b8-b850-6547c3e258bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99910dda-8d9c-4a52-902a-bd30c145e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99910dda-8d9c-4a52-902a-bd30c145e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-785962380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45de7fe-d368-4a49-afb9-335f899d3619,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:44Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34568e4a-22ec-45ee-8069-e01a81dbed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34568e4a-22ec-45ee-8069-e01a81dbed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952743e6-7404-49f6-a064-c9713ad4ad42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952743e6-7404-49f6-a064-c9713ad4ad42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45de7fe-d368-4a49-afb9-335f899d3619', 'volume_name': 'volume-f45de7fe-d368-4a49-afb9-335f899d3619', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a713bae6-8987-49b0-8f71-d6c3ff074d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a713bae6-8987-49b0-8f71-d6c3ff074d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd872c83-4d0b-4bce-909f-cf7c3ae94377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:43 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Volume f45de7fe-d368-4a49-afb9-335f899d3619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45de7fe-d368-4a49-afb9-335f899d3619', 'volume_size': 1} Jul 10 05:59:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:44 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.info" returned: 0 in 0.696s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.722s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.210s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-785962380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45de7fe-d368-4a49-afb9-335f899d3619,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:44Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Creating volume f45de7fe-d368-4a49-afb9-335f899d3619 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:44 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:44 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 1073741824 Jul 10 05:59:44 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6a5c460f-275d-4dc7-90cf-933805cf7d8b tempest-VolumesExtendTest-1422170550 None] Create snapshot completed successfully Jul 10 05:59:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:45 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 1073741824" returned: 0 in 0.905s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:45 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 Jul 10 05:59:45 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:45 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619" returned: 0 in 0.638s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.993s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd872c83-4d0b-4bce-909f-cf7c3ae94377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45de7fe-d368-4a49-afb9-335f899d3619', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b88a39b-8949-4ac8-8644-e30aaeac1f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ec3680-e226-46b7-b8e5-cb0632ff8b46]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:45 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Volume volume-f45de7fe-d368-4a49-afb9-335f899d3619 (f45de7fe-d368-4a49-afb9-335f899d3619): created successfully Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b88a39b-8949-4ac8-8644-e30aaeac1f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (41b47a4e-ae41-43b8-b850-6547c3e258bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c70e04f2-9432-454b-9c2b-0079488badea tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 05:59:45 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 Jul 10 05:59:45 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:46 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8" returned: 0 in 0.984s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e 2G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (88f3888a-6314-4d8c-a162-677e8c67baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358981e1-9f40-4e34-ba1b-73e8c77a7e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358981e1-9f40-4e34-ba1b-73e8c77a7e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1297040247',display_name='tempest-VolumesGetTest-Volume-86562048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:47Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9240dff2-3bc7-453e-8061-fef493313598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9240dff2-3bc7-453e-8061-fef493313598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3bc767-f4a2-4062-84dd-f09f8b30afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3bc767-f4a2-4062-84dd-f09f8b30afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94dd26d-587a-4f4f-8aa1-0d2d65f31cb6', 'volume_name': 'volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92972770-d115-4012-8635-fb53811e84f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92972770-d115-4012-8635-fb53811e84f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd1b087-84c0-4e69-85ef-b5f4df38e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Volume d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6', 'volume_size': 1} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e 2G" returned: 0 in 0.160s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.197s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1297040247',display_name='tempest-VolumesGetTest-Volume-86562048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:47Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Creating volume d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:46 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:46 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 1073741824 Jul 10 05:59:46 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d750762d-4ae1-4ac8-962a-013d59371d9c tempest-VolumesExtendTest-1422170550 None] Extend volume completed successfully. Jul 10 05:59:47 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 1073741824" returned: 0 in 0.964s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:48 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 Jul 10 05:59:48 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-c8d48900-53d6-4ec8-a5af-559d96aab67e-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-c8d48900-53d6-4ec8-a5af-559d96aab67e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-quobyte-85e2e197-1b04-49c3-bb0b-6577076603e8" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-85e2e197-1b04-49c3-bb0b-6577076603e8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-quobyte-c8d48900-53d6-4ec8-a5af-559d96aab67e" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-c8d48900-53d6-4ec8-a5af-559d96aab67e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Deleting offline snapshot c8d48900-53d6-4ec8-a5af-559d96aab67e of volume 85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] snapshot_file for this snap is: volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b397a58-ed86-47d2-ad28-ce9e23d8ecc3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:48 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e Jul 10 05:59:48 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:48 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6" returned: 0 in 0.726s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd1b087-84c0-4e69-85ef-b5f4df38e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6add6f84-41ab-440e-8bc3-e9a5f460d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:48 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Volume volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 (d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6): created successfully Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6add6f84-41ab-440e-8bc3-e9a5f460d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (88f3888a-6314-4d8c-a162-677e8c67baa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c07a80b4-0b29-4ee8-ba99-2d42d72bf1bb tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Lock "cinder-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:49 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e" returned: 0 in 0.832s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e2e197-1b04-49c3-bb0b-6577076603e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086e5b4-216d-41ad-83c7-8e025cb97220]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e8cf14-9ed5-48b9-be4f-22ae2a5c9f10]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:49 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 Jul 10 05:59:49 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:49 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 Jul 10 05:59:49 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:50 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:50 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e Jul 10 05:59:50 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:50 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6" returned: 0 in 0.879s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:50 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6 Jul 10 05:59:50 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:50 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6" returned: 0 in 0.684s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6" released by "delete_volume" :: held 1.615s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Created reservations ['6867c3bb-c1d4-42ac-ab56-ef946d5bef26', '223d67d8-295d-4631-8aaa-1a81ca4baa80', '71de5ce9-94fc-4903-be10-eb90165968c8', '68c2a176-36fe-4403-a423-85e42247ecbb'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:50 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e" returned: 0 in 0.863s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:50 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e Jul 10 05:59:50 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:50 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:50 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-f45de7fe-d368-4a49-afb9-335f899d3619-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Lock "cinder-f45de7fe-d368-4a49-afb9-335f899d3619-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:51 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8.c8d48900-53d6-4ec8-a5af-559d96aab67e" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-f45de7fe-d368-4a49-afb9-335f899d3619" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-f45de7fe-d368-4a49-afb9-335f899d3619" acquired by "delete_volume" :: waited 0.048s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-c8d48900-53d6-4ec8-a5af-559d96aab67e" released by "_delete_snapshot" :: held 3.423s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-85e2e197-1b04-49c3-bb0b-6577076603e8" released by "delete_snapshot" :: held 3.450s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4139bfa0-81c6-4eb8-97e8-17ea59ca4b02]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:51 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.753s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d2d5e116-84a5-4252-a557-4e0e6eb08e05 tempest-VolumesGetTest-2055482863 None] Lock "cinder-d94dd26d-587a-4f4f-8aa1-0d2d65f31cb6-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Created reservations ['a86709ac-3935-41bf-81ba-9b44550ed265', '46a9e9a9-4dc2-442a-b65d-d71174148add', '63362f20-89ef-4921-add7-ced4e1f323c0', '3b2e7a60-3868-4432-b5a6-33f7b3003f36'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:51 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 Jul 10 05:59:51 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Delete snapshot completed successfully. Jul 10 05:59:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-828caee5-4b26-4c10-b016-bfd084732362 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-c8d48900-53d6-4ec8-a5af-559d96aab67e-delete_snapshot" released by "delete_snapshot" :: held 3.657s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-85e2e197-1b04-49c3-bb0b-6577076603e8-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-85e2e197-1b04-49c3-bb0b-6577076603e8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:52 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619" returned: 0 in 0.904s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:52 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619 Jul 10 05:59:52 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "cinder-quobyte-85e2e197-1b04-49c3-bb0b-6577076603e8" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-85e2e197-1b04-49c3-bb0b-6577076603e8" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d8e47-0317-4768-9d65-c78d13ab1f9c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:52 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 Jul 10 05:59:52 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:53 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f45de7fe-d368-4a49-afb9-335f899d3619" returned: 0 in 0.890s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-f45de7fe-d368-4a49-afb9-335f899d3619" released by "delete_volume" :: held 1.862s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Created reservations ['f2da60a1-325a-413d-b82a-86f3de81f36a', 'afafa068-21c6-4ce0-88ef-540aadd34876', 'e8ba00aa-df36-4f57-9477-6062f3d17d25', '2d0eb1ba-edb2-4cdd-9892-d51b9ab5c7c8'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:53 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:53 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:53 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8" returned: 0 in 0.948s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:53 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8 Jul 10 05:59:53 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:54 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.814s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-04a4bd81-79bb-492d-8d33-c4f561018e3b tempest-VolumesGetTest-2055482863 None] Lock "cinder-f45de7fe-d368-4a49-afb9-335f899d3619-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:54 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-85e2e197-1b04-49c3-bb0b-6577076603e8" returned: 0 in 0.818s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-quobyte-85e2e197-1b04-49c3-bb0b-6577076603e8" released by "delete_volume" :: held 1.881s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (30bbea40-d3fa-44d4-8a46-fd678ad19da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c9d938-55f1-44d0-a002-1729d13fe80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c9d938-55f1-44d0-a002-1729d13fe80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-468960056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56804bf-e637-455b-831b-019f991f5daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:54Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d53144-52c1-4504-9581-680a24ba36ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d53144-52c1-4504-9581-680a24ba36ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e48c3d0-5c54-4415-bfa9-d8bbbb8e9fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e48c3d0-5c54-4415-bfa9-d8bbbb8e9fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56804bf-e637-455b-831b-019f991f5daa', 'volume_name': 'volume-d56804bf-e637-455b-831b-019f991f5daa', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e23c79b-5cf1-4989-a43f-96ab5f33942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e23c79b-5cf1-4989-a43f-96ab5f33942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e2eb62-ec31-4fca-9c7c-d22b4f708014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:54 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Volume d56804bf-e637-455b-831b-019f991f5daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56804bf-e637-455b-831b-019f991f5daa', 'volume_size': 1} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-468960056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56804bf-e637-455b-831b-019f991f5daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:54Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Creating volume d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 05:59:54 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:54 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa 1073741824 Jul 10 05:59:54 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Created reservations ['3afba618-c40a-4785-b956-3195af9e70ec', 'c2ba4ab8-bfd2-48e7-b026-78bf07f41cea', 'd056422a-592a-4195-a39f-0156ba479bf3', '124f8584-0978-4c91-84a6-e653cb7dd24d'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:54 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 05:59:54 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:55 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:55 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 05:59:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Deleted volume successfully. Jul 10 05:59:55 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa 1073741824" returned: 0 in 0.963s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-360039d7-455c-4fbe-af0a-aaf1b58ddea3 tempest-VolumesExtendTest-1422170550 None] Lock "cinder-85e2e197-1b04-49c3-bb0b-6577076603e8-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 05:59:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:55 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 05:59:55 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:56 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.697s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e2eb62-ec31-4fca-9c7c-d22b4f708014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56804bf-e637-455b-831b-019f991f5daa', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0849d37-394b-400a-ba2d-d33628ba1049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:56 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Volume volume-d56804bf-e637-455b-831b-019f991f5daa (d56804bf-e637-455b-831b-019f991f5daa): created successfully Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0849d37-394b-400a-ba2d-d33628ba1049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (30bbea40-d3fa-44d4-8a46-fd678ad19da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-88762ee6-bde1-44f2-9de4-1b012319d405 tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (bb0c0b5b-bf77-4b44-9c58-86f6dcb58cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506906b-241f-4795-a1ce-20204a9fa148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506906b-241f-4795-a1ce-20204a9fa148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1105983253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085853e1-652e-49b7-ae6a-423f59c02284,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d56804bf-e637-455b-831b-019f991f5daa,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:57Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3e00ba-996b-44b0-8b86-7bf58bba3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3e00ba-996b-44b0-8b86-7bf58bba3a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6995c9f2-47ba-4f1f-b8cb-de9df47b4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6995c9f2-47ba-4f1f-b8cb-de9df47b4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '085853e1-652e-49b7-ae6a-423f59c02284', 'volume_name': 'volume-085853e1-652e-49b7-ae6a-423f59c02284', 'volume_size': 1, 'source_volid': 'd56804bf-e637-455b-831b-019f991f5daa', 'source_volstatus': 'available'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf8f7b1-2156-4b46-9325-90ec9705c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf8f7b1-2156-4b46-9325-90ec9705c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6a4d06-7712-4840-9905-60e33a3041c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:57 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Volume 085853e1-652e-49b7-ae6a-423f59c02284: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-085853e1-652e-49b7-ae6a-423f59c02284', 'volume_size': 1, 'source_volid': 'd56804bf-e637-455b-831b-019f991f5daa', 'source_volstatus': 'available'} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 05:59:57 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Cloning volume d56804bf-e637-455b-831b-019f991f5daa to volume 085853e1-652e-49b7-ae6a-423f59c02284 Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Creating offline snapshot 123bab9e-d09d-4246-b0c7-202583e59491 of volume d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d3ce36-11c9-45ca-8dfe-16fdc69c2934]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 05:59:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:57 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 05:59:57 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:58 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.939s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:58 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 1G Jul 10 05:59:58 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:59 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 1G" returned: 0 in 1.052s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56804bf-e637-455b-831b-019f991f5daa -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 05:59:59 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56804bf-e637-455b-831b-019f991f5daa -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 Jul 10 05:59:59 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Flow 'volume_create_manager' (6d15ad74-6dc3-4321-8a14-0c36eb98f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5135077-eff2-4a50-a334-e512a226c613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5135077-eff2-4a50-a334-e512a226c613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1851704932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a06661-0401-425b-b196-34c5fd71c932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b5c2e2b19b4da7a5340a8cc2386678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:59Z,use_quota=True,user_id='3dba79c61c7348c7a3cb8b8881ad7b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4d3a3f-170c-493e-9f15-62c48313d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4d3a3f-170c-493e-9f15-62c48313d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadf2d46-6ce4-48c7-8aa9-2c63ea62851a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadf2d46-6ce4-48c7-8aa9-2c63ea62851a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a06661-0401-425b-b196-34c5fd71c932', 'volume_name': 'volume-73a06661-0401-425b-b196-34c5fd71c932', 'volume_size': 2}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc12faa-4c6b-4ab7-906b-3d0f2344a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc12faa-4c6b-4ab7-906b-3d0f2344a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152a9fb9-ae62-49a6-a29a-91427ed6fda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 05:59:59 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Volume 73a06661-0401-425b-b196-34c5fd71c932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a06661-0401-425b-b196-34c5fd71c932', 'volume_size': 2} Jul 10 05:59:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:00 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56804bf-e637-455b-831b-019f991f5daa -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491" returned: 0 in 0.781s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:00 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 is being set with open permissions: ugo+rw Jul 10 06:00:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:00 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 Jul 10 06:00:00 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:00 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491" returned: 0 in 0.765s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:00 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info Jul 10 06:00:00 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:01 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info" returned: 0 in 0.689s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:01 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info is being set with open permissions: ugo+rw Jul 10 06:00:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:01 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info Jul 10 06:00:01 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:02 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.info" returned: 0 in 0.686s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-085853e1-652e-49b7-ae6a-423f59c02284" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-085853e1-652e-49b7-ae6a-423f59c02284" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] snapshot: 123bab9e-d09d-4246-b0c7-202583e59491, volume: 085853e1-652e-49b7-ae6a-423f59c02284, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf7f3e-fe88-451f-ad4d-80f41c173240]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:02 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 Jul 10 06:00:02 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:03 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491" returned: 0 in 0.828s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56804bf-e637-455b-831b-019f991f5daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:00:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:00:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:00:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[420360d8-4049-4fd6-b5df-500b53db7e96]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:03 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 06:00:03 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:04 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.828s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:04 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:00:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:04 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 Jul 10 06:00:04 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Flow 'volume_create_manager' (629c0225-31fd-41ef-9617-7c6d8de51af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdfe6d9-f72e-4257-8de3-6ea69de77967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdfe6d9-f72e-4257-8de3-6ea69de77967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-411570508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13db3a8fc56646f88d4ec124d46af89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:08Z,use_quota=True,user_id='bf0289e0033c4ec7925323690de83d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d85fc-71e0-4216-a1b6-96ccf78e63b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d85fc-71e0-4216-a1b6-96ccf78e63b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eabef56-91b1-4ca7-9dee-7691eac320d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:07 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:00:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eabef56-91b1-4ca7-9dee-7691eac320d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6', 'volume_name': 'volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d2187a-50a1-4173-9132-bd5584f75379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d2187a-50a1-4173-9132-bd5584f75379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7f145d-8cfe-4c98-bf47-285c3f9ee6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:08 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Volume e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:00:08 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Trying to clone e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 from image b4e08d22-7293-452f-a208-7a340b669863 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:00:09 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:00:09 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:00:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731567e-e057-4413-b36b-2bb48cc970e0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:09 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284" returned: 0 in 5.443s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfbda30-a0bb-4626-8bce-a50e63c360a5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:09 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD Jul 10 06:00:09 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:09 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 06:00:09 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:10 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 is fetched for user bf0289e0033c4ec7925323690de83d69. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9c998f-11d6-4dab-8597-56ea719b97fe]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:10 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD Jul 10 06:00:10 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:10 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.957s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:00:10 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Converted 1024.00 MB image at 188.09 MB/s Jul 10 06:00:10 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 is being set with open permissions: ugo+rw Jul 10 06:00:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:10 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 Jul 10 06:00:10 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:11 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:11 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284" returned: 0 in 0.636s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-085853e1-652e-49b7-ae6a-423f59c02284" released by "_copy_volume_from_snapshot" :: held 8.827s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-123bab9e-d09d-4246-b0c7-202583e59491" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-123bab9e-d09d-4246-b0c7-202583e59491" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Deleting offline snapshot 123bab9e-d09d-4246-b0c7-202583e59491 of volume d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] snapshot_file for this snap is: volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18af256-7f13-4d17-a2c5-51eba332516f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:11 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 Jul 10 06:00:11 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:12 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56804bf-e637-455b-831b-019f991f5daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:00:12 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6e9e0b-a57b-4545-bfdf-78ee95cfbb41]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:12 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 06:00:12 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:12 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.730s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:12 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 Jul 10 06:00:12 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:13 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491" returned: 0 in 0.710s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:13 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491 Jul 10 06:00:13 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:14 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa.123bab9e-d09d-4246-b0c7-202583e59491" returned: 0 in 0.636s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-123bab9e-d09d-4246-b0c7-202583e59491" released by "_delete_snapshot" :: held 2.897s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.884s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.573s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T03:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1851704932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a06661-0401-425b-b196-34c5fd71c932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b5c2e2b19b4da7a5340a8cc2386678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T03:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T03:59:59Z,use_quota=True,user_id='3dba79c61c7348c7a3cb8b8881ad7b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Creating volume 73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:00:14 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 2147483648 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6a4d06-7712-4840-9905-60e33a3041c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085853e1-652e-49b7-ae6a-423f59c02284', 'volume_size': 1, 'source_volid': 'd56804bf-e637-455b-831b-019f991f5daa', 'source_volstatus': 'available'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:14 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 2147483648 Jul 10 06:00:14 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e673a18-51f7-4c53-8bbf-c687dfc6b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:14 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Volume volume-085853e1-652e-49b7-ae6a-423f59c02284 (085853e1-652e-49b7-ae6a-423f59c02284): created successfully Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e673a18-51f7-4c53-8bbf-c687dfc6b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (bb0c0b5b-bf77-4b44-9c58-86f6dcb58cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e1a58903-3da7-445b-8173-42083c8b3d4f tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 06:00:15 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 2147483648" returned: 0 in 0.896s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:15 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 Jul 10 06:00:15 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (41bf0769-7f56-4284-ae75-a4b5ba8ecf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202e1a17-ea68-474f-8a3d-b49c90b1def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202e1a17-ea68-474f-8a3d-b49c90b1def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1486400677',display_name='tempest-VolumesGetTest-Volume-1923473826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5fa5e8-01d8-4af3-8ca3-4028fb2131b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:15Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a687df33-cd8e-4c43-9e38-f8f58a64ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a687df33-cd8e-4c43-9e38-f8f58a64ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6b9fef-83de-4520-a1f3-c09a08d843b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6b9fef-83de-4520-a1f3-c09a08d843b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5fa5e8-01d8-4af3-8ca3-4028fb2131b3', 'volume_name': 'volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477ff30c-f23d-42e2-9c74-b50ac81fe219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477ff30c-f23d-42e2-9c74-b50ac81fe219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35bba1-b045-47cb-b205-1fa09b0dd814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Volume be5fa5e8-01d8-4af3-8ca3-4028fb2131b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3', 'volume_size': 1} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:15 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932" returned: 0 in 0.638s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.711s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-411570508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13db3a8fc56646f88d4ec124d46af89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:08Z,use_quota=True,user_id='bf0289e0033c4ec7925323690de83d69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Creating volume e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:00:15 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152a9fb9-ae62-49a6-a29a-91427ed6fda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a06661-0401-425b-b196-34c5fd71c932', 'volume_size': 2}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:15 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 1073741824 Jul 10 06:00:15 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ce1c25-bf55-42c1-a3f6-4bd048ba3ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Volume volume-73a06661-0401-425b-b196-34c5fd71c932 (73a06661-0401-425b-b196-34c5fd71c932): created successfully Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ce1c25-bf55-42c1-a3f6-4bd048ba3ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Flow 'volume_create_manager' (6d15ad74-6dc3-4321-8a14-0c36eb98f643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cdeaa814-d9a1-4b68-a5a9-6e6bd125e4da tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Created volume successfully. Jul 10 06:00:16 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 1073741824" returned: 0 in 0.798s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:16 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:00:16 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:17 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 0.632s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1486400677',display_name='tempest-VolumesGetTest-Volume-1923473826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5fa5e8-01d8-4af3-8ca3-4028fb2131b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:15Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Creating volume be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:00:17 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:17 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 1073741824 Jul 10 06:00:17 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Attempting download of b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0fd60a-6182-498b-b4e2-232529bcc0d6]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:17 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq Jul 10 06:00:17 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:18 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:18 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq" returned: 0 in 0.723s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 1073741824" returned: 0 in 0.816s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:18 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 Jul 10 06:00:18 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:18 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq Jul 10 06:00:18 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:18 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3" returned: 0 in 0.672s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:18 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.814s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq" returned: 1 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_twa640dq' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc9ff73-9fe4-4aea-b8a4-b87a0d044730]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35bba1-b045-47cb-b205-1fa09b0dd814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f03e2b-7746-4f22-bf35-7f2c3ed1bbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Creating offline snapshot 71d314e0-8841-4a02-b02a-d3763d7f1ec7 of volume 73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:00:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Volume volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 (be5fa5e8-01d8-4af3-8ca3-4028fb2131b3): created successfully Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f03e2b-7746-4f22-bf35-7f2c3ed1bbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (41bf0769-7f56-4284-ae75-a4b5ba8ecf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[51070c81-89a6-4534-927e-8cb872258b46]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cb4dcdc4-fd1e-4cbf-9674-57e3011d2f62 tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 06:00:18 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD Jul 10 06:00:18 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:18 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 Jul 10 06:00:18 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:19 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] b4e08d22-7293-452f-a208-7a340b669863 was qcow2, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:19 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:00:19 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Lock "cinder-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:19 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932" returned: 0 in 0.781s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 2G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:19 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 2G Jul 10 06:00:19 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b29a0-7286-4157-9da9-1314c5b70fbb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:19 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 Jul 10 06:00:19 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:20 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3" returned: 0 in 0.784s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:20 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 2G" returned: 0 in 0.863s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73a06661-0401-425b-b196-34c5fd71c932 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:20 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3 Jul 10 06:00:20 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:20 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73a06661-0401-425b-b196-34c5fd71c932 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 Jul 10 06:00:20 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:21 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3" returned: 0 in 0.699s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3" released by "delete_volume" :: held 1.532s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Created reservations ['9a42d545-0487-4d14-8136-5894f8b810ff', 'a167a400-1ee7-4e71-9753-d08100c53f4a', 'ca86d01e-f79a-4799-8866-59b15273f5bf', '67603382-fed9-492f-b159-84455d2f35bc'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:21 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73a06661-0401-425b-b196-34c5fd71c932 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7" returned: 0 in 0.774s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:21 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 is being set with open permissions: ugo+rw Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:21 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 Jul 10 06:00:21 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:21 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:21 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:21 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 2.073s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_zhi518owdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:00:21 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Converted 112.00 MB image at 53.99 MB/s Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:21 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 1G Jul 10 06:00:21 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-085853e1-652e-49b7-ae6a-423f59c02284-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Lock "cinder-085853e1-652e-49b7-ae6a-423f59c02284-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-085853e1-652e-49b7-ae6a-423f59c02284" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-085853e1-652e-49b7-ae6a-423f59c02284" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e4bdc8-92b5-4607-893c-29fdbf8060e3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:22 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:22 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.738s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7" returned: 0 in 0.819s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:22 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 Jul 10 06:00:22 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-13f6346e-76e4-4cb7-86e5-d16c750d4299 tempest-VolumesGetTest-2055482863 None] Lock "cinder-be5fa5e8-01d8-4af3-8ca3-4028fb2131b3-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:22 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info Jul 10 06:00:22 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:22 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 1G" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e24304-9cb8-4a81-80a5-a75446c84497]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:22 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:00:22 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:22 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:22 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info" returned: 0 in 0.681s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:22 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info is being set with open permissions: ugo+rw Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284" returned: 0 in 0.814s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:22 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info Jul 10 06:00:22 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:22 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284 Jul 10 06:00:22 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:23 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 0.779s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:23 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:00:23 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:23 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-085853e1-652e-49b7-ae6a-423f59c02284" returned: 0 in 0.651s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-085853e1-652e-49b7-ae6a-423f59c02284" released by "delete_volume" :: held 1.520s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:23 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.info" returned: 0 in 0.699s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c2bbf4c7-f065-45fd-ba6c-36d5341bd982 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Create snapshot completed successfully Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Created reservations ['a9d43ae4-a139-485a-a3ee-e4e2265868bf', '237fe1ca-d0b6-42e5-90f9-01ff44a9f169', '337ca065-27bb-499d-b613-475b11b04f2f', 'deb19ce2-e66b-4c6f-8288-c4fd62177600'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:23 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:23 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:23 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 1 in 0.764s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Downloaded image b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 for user bf0289e0033c4ec7925323690de83d69 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Marking volume e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Copying metadata from image b4e08d22-7293-452f-a208-7a340b669863 to e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:00:23 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Creating volume glance metadata for volume e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 backed by image b4e08d22-7293-452f-a208-7a340b669863 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7f145d-8cfe-4c98-bf47-285c3f9ee6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb78dfe-54ae-4fcf-8fe0-eecf0628d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Volume volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 (e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6): created successfully Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb78dfe-54ae-4fcf-8fe0-eecf0628d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Flow 'volume_create_manager' (629c0225-31fd-41ef-9617-7c6d8de51af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7b57343c-8812-4ff7-a210-76112b85f2da tempest-TestShelveInstance-1837261439 None] Created volume successfully. Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-d56804bf-e637-455b-831b-019f991f5daa-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Lock "cinder-d56804bf-e637-455b-831b-019f991f5daa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-d56804bf-e637-455b-831b-019f991f5daa" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-d56804bf-e637-455b-831b-019f991f5daa" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:24 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.673s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[31845aad-e50f-463c-9836-9d1050131964]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "cinder-71d314e0-8841-4a02-b02a-d3763d7f1ec7-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4cf6f4fe-325f-410d-99f8-15197b5eee32 tempest-VolumesGetTest-2055482863 None] Lock "cinder-085853e1-652e-49b7-ae6a-423f59c02284-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-71d314e0-8841-4a02-b02a-d3763d7f1ec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "cinder-quobyte-73a06661-0401-425b-b196-34c5fd71c932" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-quobyte-73a06661-0401-425b-b196-34c5fd71c932" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "cinder-quobyte-71d314e0-8841-4a02-b02a-d3763d7f1ec7" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-quobyte-71d314e0-8841-4a02-b02a-d3763d7f1ec7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Deleting offline snapshot 71d314e0-8841-4a02-b02a-d3763d7f1ec7 of volume 73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] snapshot_file for this snap is: volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc41c1-335f-43aa-bf48-ee1756b47fe9]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:24 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 06:00:24 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:24 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 Jul 10 06:00:24 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:25 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.826s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:25 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa Jul 10 06:00:25 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:25 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7" returned: 0 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73a06661-0401-425b-b196-34c5fd71c932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ddb208-80c9-47d4-a68d-3a7cdc501645]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:25 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 Jul 10 06:00:25 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:25 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d56804bf-e637-455b-831b-019f991f5daa" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-d56804bf-e637-455b-831b-019f991f5daa" released by "delete_volume" :: held 1.623s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Created reservations ['393b6b67-f54c-40f6-a7b0-7fd2ef64e8d3', '97e1af7b-4c92-4806-8c00-54aae43bfaa6', '3ad78a10-e271-414b-b5aa-48f0a46d91e0', '72ea3466-9578-4fe0-ad69-df74b80d0c1a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:26 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:26 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:26 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:26 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 Jul 10 06:00:26 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:26 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.752s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 06:00:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-02eec9ab-8b2a-420d-9daf-c74f4fc1e294 tempest-VolumesGetTest-2055482863 None] Lock "cinder-d56804bf-e637-455b-831b-019f991f5daa-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:27 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7" returned: 0 in 0.841s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:27 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7 Jul 10 06:00:27 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (ebdb47d0-40eb-4797-a33d-fd46affda197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103c11e6-9a4c-491b-9f97-2be84ab78f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103c11e6-9a4c-491b-9f97-2be84ab78f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-500221001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ea046-b15b-4d82-946a-a0ccafd56640,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:27Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c37466a-de7a-48e1-880f-69bff1157708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c37466a-de7a-48e1-880f-69bff1157708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a9b93-c717-4dc2-8c82-65b0d1189aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a9b93-c717-4dc2-8c82-65b0d1189aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f21ea046-b15b-4d82-946a-a0ccafd56640', 'volume_name': 'volume-f21ea046-b15b-4d82-946a-a0ccafd56640', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6916c4-f4b5-4ab0-8c47-e435051c9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6916c4-f4b5-4ab0-8c47-e435051c9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7de0074-71ed-4650-b6e1-1d3a026a06c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:27 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Volume f21ea046-b15b-4d82-946a-a0ccafd56640: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f21ea046-b15b-4d82-946a-a0ccafd56640', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Trying to clone f21ea046-b15b-4d82-946a-a0ccafd56640 from image b4e08d22-7293-452f-a208-7a340b669863 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:00:27 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932.71d314e0-8841-4a02-b02a-d3763d7f1ec7" returned: 0 in 0.686s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:00:27 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-quobyte-71d314e0-8841-4a02-b02a-d3763d7f1ec7" released by "_delete_snapshot" :: held 3.469s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-quobyte-73a06661-0401-425b-b196-34c5fd71c932" released by "delete_snapshot" :: held 3.498s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615fa13-80a5-4b97-850a-e655fd0ec479]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Created reservations ['428429e7-f141-4f54-b499-14d793df1ad0', '701e0e9c-d066-4aa8-8683-fe5106f65f57', '2fe0f5d1-3f87-4b2a-bec1-3669a8bd7614', 'f350d256-5576-4f80-9dbd-ae0a267f6af4'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Delete snapshot completed successfully. Jul 10 06:00:28 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD Jul 10 06:00:28 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fb0b326a-3271-4176-bd37-2fb0e057775f tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-71d314e0-8841-4a02-b02a-d3763d7f1ec7-delete_snapshot" released by "delete_snapshot" :: held 3.670s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "cinder-73a06661-0401-425b-b196-34c5fd71c932-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:28 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD" returned: 0 in 0.744s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 is fetched for user 27d922712f24478a902a66705f3f9c36. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-73a06661-0401-425b-b196-34c5fd71c932-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "cinder-quobyte-73a06661-0401-425b-b196-34c5fd71c932" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-quobyte-73a06661-0401-425b-b196-34c5fd71c932" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988b60e-93d5-4d84-b41d-c3190852416d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[191d9bf4-9dc4-4d57-a65a-718ab64f3d92]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:28 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:28 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD Jul 10 06:00:28 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:28 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:28 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 Jul 10 06:00:28 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:29 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-500221001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21ea046-b15b-4d82-946a-a0ccafd56640,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:27Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Creating volume f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:00:29 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:29 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.703s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:00:29 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 1073741824 Jul 10 06:00:29 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:29 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932" returned: 0 in 0.828s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:29 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932 Jul 10 06:00:29 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:30 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73a06661-0401-425b-b196-34c5fd71c932" returned: 0 in 0.660s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-quobyte-73a06661-0401-425b-b196-34c5fd71c932" released by "delete_volume" :: held 1.562s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Created reservations ['6c322c0e-47e5-4a67-855d-c097c54b07ef', '0d20ccb2-802a-4cc3-bb66-fdf978974f1d', 'ab347a47-0ecd-489e-a97f-1b713423952b', '6df59e32-f59c-4417-a916-0be687594660'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:30 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:30 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:30 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 1073741824" returned: 0 in 0.950s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:30 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:30 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:31 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.800s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:31 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Deleted volume successfully. Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b0fde97d-6c0e-4497-9b95-781af5f309d9 tempest-VolumesSnapshotNegativeTestJSON-1079452991 None] Lock "cinder-73a06661-0401-425b-b196-34c5fd71c932-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:31 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 0 in 0.887s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Attempting download of b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume f21ea046-b15b-4d82-946a-a0ccafd56640. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[471e9bf5-26df-433f-839e-c59765a43b4b]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:31 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42 Jul 10 06:00:31 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2a5f3-eb4d-4e7b-a0da-ae09c7636812]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:32 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:00:32 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:32 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:32 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42 Jul 10 06:00:32 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:33 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 1.009s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:33 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:00:33 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:33 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42" returned: 1 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4e08d22-7293-452f-a208-7a340b669863_s8z04v42' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a81d8-819f-4e51-92f9-5cd2e40326a0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:33 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD Jul 10 06:00:33 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:33 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 1 in 0.824s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.887s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=111,cinder:INSERT=40,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=99,cinder:INSERT=39,cinder:UPDATE=135,cinder:DELETE=12 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4029492-740a-4e48-a70b-6433b11743b7', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:00:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-48b62bd8-e0bf-416b-90d4-916a808161e1 req-440297f4-5a78-4d28-a403-78abba4d78b0 tempest-TestShelveInstance-1837261439 None] attachment_update completed successfully. Jul 10 06:00:33 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD" returned: 0 in 0.802s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] b4e08d22-7293-452f-a208-7a340b669863 was qcow2, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:00:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:34 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:34 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:36 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 0 in 2.170s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:36 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4e08d22-7293-452f-a208-7a340b669863_g2tl00z7devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:00:36 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Converted 112.00 MB image at 51.57 MB/s Jul 10 06:00:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:36 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 1G Jul 10 06:00:36 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:36 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 1G" returned: 0 in 0.774s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:36 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f949cbdb-3021-4e88-8a55-dd6041b07ad2]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:37 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:37 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:37 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 0 in 0.993s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:38 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:38 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:38 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 1 in 0.843s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Downloaded image b4e08d22-7293-452f-a208-7a340b669863 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}])) to volume f21ea046-b15b-4d82-946a-a0ccafd56640 successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Temporary image b4e08d22-7293-452f-a208-7a340b669863 for user 27d922712f24478a902a66705f3f9c36 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Marking volume f21ea046-b15b-4d82-946a-a0ccafd56640 as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Copying metadata from image b4e08d22-7293-452f-a208-7a340b669863 to f21ea046-b15b-4d82-946a-a0ccafd56640. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Creating volume glance metadata for volume f21ea046-b15b-4d82-946a-a0ccafd56640 backed by image b4e08d22-7293-452f-a208-7a340b669863 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7de0074-71ed-4650-b6e1-1d3a026a06c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21ea046-b15b-4d82-946a-a0ccafd56640', 'volume_size': 1, 'image_id': 'b4e08d22-7293-452f-a208-7a340b669863', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4e08d22-7293-452f-a208-7a340b669863', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01fd8a4209f8432d98dab08eba7ae34d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4e08d22-7293-452f-a208-7a340b669863', 'created_at': datetime.datetime(2026, 7, 10, 3, 40, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 3, 40, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4e08d22-7293-452f-a208-7a340b669863/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a8f69a-1832-4437-a957-cdcae0998301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Volume volume-f21ea046-b15b-4d82-946a-a0ccafd56640 (f21ea046-b15b-4d82-946a-a0ccafd56640): created successfully Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a8f69a-1832-4437-a957-cdcae0998301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (ebdb47d0-40eb-4797-a33d-fd46affda197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8929771d-3a7f-40c6-bc3d-b9fb9f2d629c tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (91252c1e-4068-4d3e-b1a9-8115a1e12c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c530b1-754e-461b-8c6d-eeff82f46f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c530b1-754e-461b-8c6d-eeff82f46f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1160685548',display_name='tempest-VolumesGetTest-Volume-1768126836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9753bcbd-fbfa-47eb-8a1b-52a976184250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:40Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0cfd45-e59c-4305-83c0-9cef2414cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0cfd45-e59c-4305-83c0-9cef2414cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac13df8-51b8-42cb-9524-e1db77436ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac13df8-51b8-42cb-9524-e1db77436ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9753bcbd-fbfa-47eb-8a1b-52a976184250', 'volume_name': 'volume-9753bcbd-fbfa-47eb-8a1b-52a976184250', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46021194-8496-4259-8261-f034bcac30a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46021194-8496-4259-8261-f034bcac30a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801b36e6-d36a-4bba-bc88-53f42795fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Volume 9753bcbd-fbfa-47eb-8a1b-52a976184250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9753bcbd-fbfa-47eb-8a1b-52a976184250', 'volume_size': 1} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:00:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1160685548',display_name='tempest-VolumesGetTest-Volume-1768126836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9753bcbd-fbfa-47eb-8a1b-52a976184250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93021d7bfcdc475c986868079707a626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:00:40Z,use_quota=True,user_id='27d922712f24478a902a66705f3f9c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Creating volume 9753bcbd-fbfa-47eb-8a1b-52a976184250 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:00:40 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:00:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:40 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 1073741824 Jul 10 06:00:40 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:41 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 1073741824" returned: 0 in 1.016s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:41 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 Jul 10 06:00:41 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:42 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250" returned: 0 in 0.844s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801b36e6-d36a-4bba-bc88-53f42795fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9753bcbd-fbfa-47eb-8a1b-52a976184250', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef599ac-e419-42d1-bd89-a10ad8fe2f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:00:42 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Volume volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 (9753bcbd-fbfa-47eb-8a1b-52a976184250): created successfully Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef599ac-e419-42d1-bd89-a10ad8fe2f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:00:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Flow 'volume_create_manager' (91252c1e-4068-4d3e-b1a9-8115a1e12c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:00:42 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-553da9c9-29e6-46d6-8193-6c296281db72 tempest-VolumesGetTest-2055482863 None] Created volume successfully. Jul 10 06:00:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-9753bcbd-fbfa-47eb-8a1b-52a976184250-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Lock "cinder-9753bcbd-fbfa-47eb-8a1b-52a976184250-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-9753bcbd-fbfa-47eb-8a1b-52a976184250" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-9753bcbd-fbfa-47eb-8a1b-52a976184250" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[806c720c-48cb-4dd1-9b53-c0414ae7ded1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:43 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 Jul 10 06:00:43 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:45 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250" returned: 0 in 1.261s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:45 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250 Jul 10 06:00:45 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:45 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9753bcbd-fbfa-47eb-8a1b-52a976184250" returned: 0 in 0.913s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-9753bcbd-fbfa-47eb-8a1b-52a976184250" released by "delete_volume" :: held 2.240s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Created reservations ['e05dc3d0-f4f5-4cac-9b2d-98593a1781d4', '5ff10e3b-bdb2-4f6e-b4ad-a3cac4e24350', '31b23d8f-9260-4f80-b65f-277157c7684f', 'fc59080a-6077-488d-bc63-12954511c4c2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:46 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:46 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:47 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c3c2790-4f04-4bbc-bcc4-c8af8a52765f tempest-VolumesGetTest-2055482863 None] Lock "cinder-9753bcbd-fbfa-47eb-8a1b-52a976184250-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-f21ea046-b15b-4d82-946a-a0ccafd56640-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Lock "cinder-f21ea046-b15b-4d82-946a-a0ccafd56640-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Acquiring lock "cinder-quobyte-f21ea046-b15b-4d82-946a-a0ccafd56640" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-f21ea046-b15b-4d82-946a-a0ccafd56640" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e072fc37-9e9d-4cbf-8cae-3602608a52e5]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:00:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:47 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:47 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:48 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 0 in 0.881s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:48 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:48 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:49 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 1 in 0.899s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:00:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:49 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640 Jul 10 06:00:49 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:49 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f21ea046-b15b-4d82-946a-a0ccafd56640" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Lock "cinder-quobyte-f21ea046-b15b-4d82-946a-a0ccafd56640" released by "delete_volume" :: held 2.586s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Created reservations ['b98adda6-ad70-41bf-a1c7-64af8ac913d5', 'e43562f0-2564-4a26-9d88-0d032270ab0a', '3cf8ded4-d13d-4bdd-a1db-2dbced5e645a', 'bde80dba-ec18-41d4-af89-0fb656f0aa3b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:00:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:00:50 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:00:50 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:00:51 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 10 06:00:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.988s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:00:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:00:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Deleted volume successfully. Jul 10 06:00:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-08e449ab-6476-42ad-9631-ab5dc22a04f1 tempest-VolumesGetTest-2055482863 None] Lock "cinder-f21ea046-b15b-4d82-946a-a0ccafd56640-delete_volume" released by "delete_volume" :: held 3.845s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:01:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=23,cinder:SELECT=18,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:01:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=27,cinder:UPDATE=23,cinder:INSERT=10 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:01:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-a159f142-ba9a-4e8f-91e2-2c58a36e8c3c req-c25f6c9d-4dc9-4603-ad43-9b7168890ab8 tempest-TestShelveInstance-1837261439 None] Terminate volume connection completed successfully. Jul 10 06:01:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-a159f142-ba9a-4e8f-91e2-2c58a36e8c3c req-c25f6c9d-4dc9-4603-ad43-9b7168890ab8 tempest-TestShelveInstance-1837261439 None] Deleting attachment e4029492-740a-4e48-a70b-6433b11743b7. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:01:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb3f7b8-3c1e-4649-ac52-15490e362425]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:18 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:01:18 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:19 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 1.182s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:19 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:01:19 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:20 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 1 in 0.953s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:01:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.219s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f35d2182-010b-4046-b97c-3522db79ab1f', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:01:20 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-6210e61d-4bd5-45dd-a93b-69ae4be2786d req-7232c331-f0f5-4ac7-8a8b-4b01cb559cfd tempest-TestShelveInstance-1837261439 None] attachment_update completed successfully. Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Flow 'volume_create_manager' (59d3db09-b8f5-4417-a0d7-3e40f73779c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c745457a-a372-4fa3-b932-e3e43bab0050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c745457a-a372-4fa3-b932-e3e43bab0050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-997898538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbcc2c1-bc3a-4374-805c-f536ed914345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb6fc0ce4db41a9ad2e832b4212c85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:26Z,use_quota=True,user_id='da4d5e9a487041ad9d7fb52d9a97de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1e548d-9834-4387-8e7c-f9f82c413ffb),volume_type_id=3f1e548d-9834-4387-8e7c-f9f82c413ffb)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adbc649-0ada-4870-b593-5f0bf8496518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adbc649-0ada-4870-b593-5f0bf8496518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa805ba-e280-40ae-bb63-e9b1bc140547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa805ba-e280-40ae-bb63-e9b1bc140547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbcc2c1-bc3a-4374-805c-f536ed914345', 'volume_name': 'volume-2dbcc2c1-bc3a-4374-805c-f536ed914345', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798e344a-89cb-4ed9-b2af-ec90219cc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798e344a-89cb-4ed9-b2af-ec90219cc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fec368-51d7-4411-86f8-41238b634b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume 2dbcc2c1-bc3a-4374-805c-f536ed914345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbcc2c1-bc3a-4374-805c-f536ed914345', 'volume_size': 1} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-997898538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbcc2c1-bc3a-4374-805c-f536ed914345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb6fc0ce4db41a9ad2e832b4212c85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:26Z,use_quota=True,user_id='da4d5e9a487041ad9d7fb52d9a97de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1e548d-9834-4387-8e7c-f9f82c413ffb),volume_type_id=3f1e548d-9834-4387-8e7c-f9f82c413ffb)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Creating volume 2dbcc2c1-bc3a-4374-805c-f536ed914345 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:01:26 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:01:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:26 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 1073741824 Jul 10 06:01:26 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Flow 'volume_create_manager' (811787af-a59c-4ecd-a334-659341e804ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df3c589-64de-462b-8260-71a1a1c9561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df3c589-64de-462b-8260-71a1a1c9561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-631010333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a8c053-bbbf-4241-838f-a03267832fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb6fc0ce4db41a9ad2e832b4212c85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:27Z,use_quota=True,user_id='da4d5e9a487041ad9d7fb52d9a97de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295acf3b-5c99-4468-8852-33236072700a),volume_type_id=295acf3b-5c99-4468-8852-33236072700a)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8c39af-3596-4d1c-86d7-8592f3b57d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8c39af-3596-4d1c-86d7-8592f3b57d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cb84e5-f8db-4542-9e64-5a3fa4db90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cb84e5-f8db-4542-9e64-5a3fa4db90e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a8c053-bbbf-4241-838f-a03267832fe4', 'volume_name': 'volume-b4a8c053-bbbf-4241-838f-a03267832fe4', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bd44f0-1512-43c6-b4be-61d496fc9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bd44f0-1512-43c6-b4be-61d496fc9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b6b645-bd45-4c6b-a114-451db26d2157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume b4a8c053-bbbf-4241-838f-a03267832fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a8c053-bbbf-4241-838f-a03267832fe4', 'volume_size': 1} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Flow 'volume_create_manager' (79eb8fca-2f11-455d-bee6-5ab6361dc92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705fba85-af59-4ffe-b802-79d1641862db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705fba85-af59-4ffe-b802-79d1641862db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2006899729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3141f08-a4e3-4de6-b52e-04e69b1abe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb6fc0ce4db41a9ad2e832b4212c85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:28Z,use_quota=True,user_id='da4d5e9a487041ad9d7fb52d9a97de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efc001e2-fa44-4002-81b8-3b8f9496ff2b),volume_type_id=efc001e2-fa44-4002-81b8-3b8f9496ff2b)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092de432-1e93-49bb-aec8-83bc181c9df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092de432-1e93-49bb-aec8-83bc181c9df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78271352-96fd-4f1a-ae29-01b57cc3597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:01:27 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 1073741824" returned: 0 in 1.237s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:27 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 Jul 10 06:01:27 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78271352-96fd-4f1a-ae29-01b57cc3597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3141f08-a4e3-4de6-b52e-04e69b1abe2b', 'volume_name': 'volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b', 'volume_size': 1, 'image_id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a3181b-b8b0-4228-b885-9e4ae2487318', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--664980264', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bdb6fc0ce4db41a9ad2e832b4212c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'created_at': datetime.datetime(2026, 7, 10, 4, 1, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 1, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a3181b-b8b0-4228-b885-9e4ae2487318/file', 'properties': {}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98e2ed5-243c-4600-8a90-501050031564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98e2ed5-243c-4600-8a90-501050031564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7aeeab-58af-4a6b-b1d3-7f4ce01722cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:28 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume c3141f08-a4e3-4de6-b52e-04e69b1abe2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b', 'volume_size': 1, 'image_id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a3181b-b8b0-4228-b885-9e4ae2487318', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--664980264', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bdb6fc0ce4db41a9ad2e832b4212c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'created_at': datetime.datetime(2026, 7, 10, 4, 1, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 1, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a3181b-b8b0-4228-b885-9e4ae2487318/file', 'properties': {}}, 'image_service': } Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Trying to clone c3141f08-a4e3-4de6-b52e-04e69b1abe2b from image b5a3181b-b8b0-4228-b885-9e4ae2487318 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5a3181b-b8b0-4228-b885-9e4ae2487318', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:01:28 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:01:28 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345" returned: 0 in 0.857s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-631010333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a8c053-bbbf-4241-838f-a03267832fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb6fc0ce4db41a9ad2e832b4212c85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:27Z,use_quota=True,user_id='da4d5e9a487041ad9d7fb52d9a97de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295acf3b-5c99-4468-8852-33236072700a),volume_type_id=295acf3b-5c99-4468-8852-33236072700a)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Creating volume b4a8c053-bbbf-4241-838f-a03267832fe4 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:01:28 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:28 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 1073741824 Jul 10 06:01:28 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fec368-51d7-4411-86f8-41238b634b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbcc2c1-bc3a-4374-805c-f536ed914345', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6c953e-a5ea-4550-873e-feee74384404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b2f286-cb1f-4e30-9578-82f8f42a028f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:28 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 (2dbcc2c1-bc3a-4374-805c-f536ed914345): created successfully Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6c953e-a5ea-4550-873e-feee74384404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Flow 'volume_create_manager' (59d3db09-b8f5-4417-a0d7-3e40f73779c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:28 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:01:28 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4de89e54-6f5e-45f4-944c-985f79342f29 tempest-TestInstancesWithCinderVolumes-2087837060 None] Created volume successfully. Jul 10 06:01:29 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD Jul 10 06:01:29 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:29 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.761s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:01:29 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 1073741824" returned: 0 in 0.941s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:29 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Temporary image b5a3181b-b8b0-4228-b885-9e4ae2487318 is fetched for user da4d5e9a487041ad9d7fb52d9a97de78. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:29 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 Jul 10 06:01:29 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02a08b-bfd3-44a5-bacd-5b91412095a8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:29 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD Jul 10 06:01:29 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:30 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4" returned: 0 in 1.066s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:30 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b6b645-bd45-4c6b-a114-451db26d2157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a8c053-bbbf-4241-838f-a03267832fe4', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fc99a1-45f0-46cf-9194-84d1df1abe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD" returned: 0 in 1.066s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2006899729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3141f08-a4e3-4de6-b52e-04e69b1abe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb6fc0ce4db41a9ad2e832b4212c85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:28Z,use_quota=True,user_id='da4d5e9a487041ad9d7fb52d9a97de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efc001e2-fa44-4002-81b8-3b8f9496ff2b),volume_type_id=efc001e2-fa44-4002-81b8-3b8f9496ff2b)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Creating volume c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:01:30 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:30 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume volume-b4a8c053-bbbf-4241-838f-a03267832fe4 (b4a8c053-bbbf-4241-838f-a03267832fe4): created successfully Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fc99a1-45f0-46cf-9194-84d1df1abe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:30 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b 1073741824 Jul 10 06:01:30 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Flow 'volume_create_manager' (811787af-a59c-4ecd-a334-659341e804ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-42a3086c-09a4-4a35-aa2c-431f35482120 tempest-TestInstancesWithCinderVolumes-2087837060 None] Created volume successfully. Jul 10 06:01:31 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b 1073741824" returned: 0 in 0.902s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:31 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:01:31 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:32 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 0 in 0.651s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:01:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:32 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Attempting download of b5a3181b-b8b0-4228-b885-9e4ae2487318 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5a3181b-b8b0-4228-b885-9e4ae2487318', 'metadata': {}}])) to volume c3141f08-a4e3-4de6-b52e-04e69b1abe2b. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:01:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43923f-a386-4430-a415-627b1562eda0]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:32 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m Jul 10 06:01:32 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:33 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m" returned: 0 in 0.796s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:33 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m Jul 10 06:01:33 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:34 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m" returned: 1 in 0.762s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5a3181b-b8b0-4228-b885-9e4ae2487318_zifkz07m' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:01:34 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6206760c-5f5f-483a-9f4c-cf0bcf785c0d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:34 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD Jul 10 06:01:34 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:35 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:35 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] b5a3181b-b8b0-4228-b885-9e4ae2487318 was qcow2, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:01:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:35 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:01:35 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:36 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 0 in 1.945s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:36 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5a3181b-b8b0-4228-b885-9e4ae2487318_sl74evjtdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:01:36 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Converted 112.00 MB image at 57.53 MB/s Jul 10 06:01:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:37 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b 1G Jul 10 06:01:37 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:37 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b 1G" returned: 0 in 0.726s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f6d912-4db2-43fd-a506-1ae3d1958250]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:37 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:01:37 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:38 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:38 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:01:38 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:39 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 1 in 0.744s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Downloaded image b5a3181b-b8b0-4228-b885-9e4ae2487318 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5a3181b-b8b0-4228-b885-9e4ae2487318', 'metadata': {}}])) to volume c3141f08-a4e3-4de6-b52e-04e69b1abe2b successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Temporary image b5a3181b-b8b0-4228-b885-9e4ae2487318 for user da4d5e9a487041ad9d7fb52d9a97de78 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Marking volume c3141f08-a4e3-4de6-b52e-04e69b1abe2b as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Copying metadata from image b5a3181b-b8b0-4228-b885-9e4ae2487318 to c3141f08-a4e3-4de6-b52e-04e69b1abe2b. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Creating volume glance metadata for volume c3141f08-a4e3-4de6-b52e-04e69b1abe2b backed by image b5a3181b-b8b0-4228-b885-9e4ae2487318 with: {'image_id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'image_name': 'tempest-scenario-img--664980264', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7aeeab-58af-4a6b-b1d3-7f4ce01722cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b', 'volume_size': 1, 'image_id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5a3181b-b8b0-4228-b885-9e4ae2487318', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--664980264', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bdb6fc0ce4db41a9ad2e832b4212c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5a3181b-b8b0-4228-b885-9e4ae2487318', 'created_at': datetime.datetime(2026, 7, 10, 4, 1, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 1, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5a3181b-b8b0-4228-b885-9e4ae2487318/file', 'properties': {}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb4fef8-e8ad-4853-adf9-05896b9c4935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Volume volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b (c3141f08-a4e3-4de6-b52e-04e69b1abe2b): created successfully Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb4fef8-e8ad-4853-adf9-05896b9c4935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Flow 'volume_create_manager' (79eb8fca-2f11-455d-bee6-5ab6361dc92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8099e213-5839-4721-a67e-fbd528e2c10c tempest-TestInstancesWithCinderVolumes-2087837060 None] Created volume successfully. Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Flow 'volume_create_manager' (d12f1878-d8f3-4663-953a-6044441e46b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bc4a9e-6c82-4e22-bbb1-82946d815003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bc4a9e-6c82-4e22-bbb1-82946d815003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-115012594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c52733-d4cb-42fd-ad8d-d090990dd0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290a4e8269746ae99187a4793fd5742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:41Z,use_quota=True,user_id='07196edcb0f74ca587c87c6497dda98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea8b1f5-11f5-4d16-9415-1de3c470ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea8b1f5-11f5-4d16-9415-1de3c470ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ecc7e9-a139-4227-8440-fb9fe5cde00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ecc7e9-a139-4227-8440-fb9fe5cde00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c52733-d4cb-42fd-ad8d-d090990dd0d2', 'volume_name': 'volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd1ac52-520a-44cd-a3a7-e82f234e164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd1ac52-520a-44cd-a3a7-e82f234e164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532c2c56-bc6e-4cb5-9aa7-dfc6ff0219a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Volume 62c52733-d4cb-42fd-ad8d-d090990dd0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2', 'volume_size': 1} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-115012594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c52733-d4cb-42fd-ad8d-d090990dd0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b290a4e8269746ae99187a4793fd5742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:01:41Z,use_quota=True,user_id='07196edcb0f74ca587c87c6497dda98e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Creating volume 62c52733-d4cb-42fd-ad8d-d090990dd0d2 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:01:40 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:01:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:41 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 1073741824 Jul 10 06:01:41 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:41 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 1073741824" returned: 0 in 0.970s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:42 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 Jul 10 06:01:42 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:42 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:01:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532c2c56-bc6e-4cb5-9aa7-dfc6ff0219a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ec68b8-b145-4f2e-8f27-f1d9354a9771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:01:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Volume volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 (62c52733-d4cb-42fd-ad8d-d090990dd0d2): created successfully Jul 10 06:01:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ec68b8-b145-4f2e-8f27-f1d9354a9771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:01:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Flow 'volume_create_manager' (d12f1878-d8f3-4663-953a-6044441e46b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:01:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-bb7420b9-6185-4461-b7db-5314c94f1605 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Created volume successfully. Jul 10 06:01:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b24efe-7961-45f3-bf74-e84d74aa85ec]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:48 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 Jul 10 06:01:48 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:48 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f2b685d-03f2-43b3-a76a-809bc8931216', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:01:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-27a0e459-d570-4b3d-8083-a1a9da2ba87d req-352a5325-c73f-4ec3-88fa-fedaf2a1ca82 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] attachment_update completed successfully. Jul 10 06:01:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:01:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:01:50 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[93898a85-c6cd-4fb6-95f2-8067e8426acc]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:50 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:01:50 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:50 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 0 in 0.843s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:51 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:01:51 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:51 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 1 in 0.766s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:01:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.652s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:01:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ca50d42-4a4e-47b5-8510-1369b67a1ff1', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:01:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-beb5ff70-87b0-4899-9125-529885aa1a4c req-4fe7f0ae-780d-462c-addb-5172bfe9b4b7 tempest-TestInstancesWithCinderVolumes-2087837060 None] attachment_update completed successfully. Jul 10 06:01:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-165016d8-9413-4178-905e-549d443f4fb8 req-4256b084-ca1e-49e1-ac20-470893b153df tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Terminate volume connection completed successfully. Jul 10 06:01:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-165016d8-9413-4178-905e-549d443f4fb8 req-4256b084-ca1e-49e1-ac20-470893b153df tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Deleting attachment 1f2b685d-03f2-43b3-a76a-809bc8931216. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:01:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Acquiring lock "cinder-62c52733-d4cb-42fd-ad8d-d090990dd0d2-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:01:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "cinder-62c52733-d4cb-42fd-ad8d-d090990dd0d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:01:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Acquiring lock "cinder-quobyte-62c52733-d4cb-42fd-ad8d-d090990dd0d2" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:01:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "cinder-quobyte-62c52733-d4cb-42fd-ad8d-d090990dd0d2" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:01:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c45467-8764-40ab-b973-5a0f43de9684]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:01:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:58 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 Jul 10 06:01:58 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:01:59 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 10 06:01:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2" returned: 0 in 1.188s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:01:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:01:59 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2 Jul 10 06:01:59 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:00 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-351ef582-fcde-486e-bd4c-5035682861ee req-674299b6-870f-4c81-a559-ed38b4c956a1 tempest-TestShelveInstance-1837261439 None] Terminate volume connection completed successfully. Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-351ef582-fcde-486e-bd4c-5035682861ee req-674299b6-870f-4c81-a559-ed38b4c956a1 tempest-TestShelveInstance-1837261439 None] Deleting attachment f35d2182-010b-4046-b97c-3522db79ab1f. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:02:00 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-62c52733-d4cb-42fd-ad8d-d090990dd0d2" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "cinder-quobyte-62c52733-d4cb-42fd-ad8d-d090990dd0d2" released by "delete_volume" :: held 2.043s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Created reservations ['203b998d-d513-4688-9842-08bc766fc703', 'f7d1180c-edc9-43cb-9e87-0435156fdffb', '5c6bbfe0-5a8b-4075-8ba9-538d8aecd430', 'cf2207ce-050f-4a75-8936-3798530a87fa'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:00 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:02:00 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Acquiring lock "cinder-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Lock "cinder-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Acquiring lock "cinder-quobyte-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Lock "cinder-quobyte-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f7231-6bb5-4c2f-9769-1ca9fea17490]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:01 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:02:01 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:01 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.278s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:01 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:02:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Deleted volume successfully. Jul 10 06:02:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-59ba1986-800f-42df-aae5-0b913b3b00c7 tempest-TestServerVolumeAttachScenarioOldVersion-1688540657 None] Lock "cinder-62c52733-d4cb-42fd-ad8d-d090990dd0d2-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:02 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 1.217s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:02 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:02:02 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:03 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 1 in 1.192s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:03 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6 Jul 10 06:02:03 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:04 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" returned: 0 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Lock "cinder-quobyte-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6" released by "delete_volume" :: held 3.396s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:04 devstack cinder-volume[87449]: DEBUG cinder.quota [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Created reservations ['ca1899ad-d569-4c18-9813-5b1acdafe22c', 'ff730a67-53ec-43b4-b944-75e5cc43ebeb', '75540d1c-4c15-4e47-b036-bbe5e373750e', 'eb0c3af4-79c1-4f97-841d-91d74de7e98c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:02:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=41,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:02:04 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=44,cinder:UPDATE=32,cinder:INSERT=13 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:02:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:05 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:02:05 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:06 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.766s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:06 devstack cinder-volume[87449]: DEBUG cinder.manager [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:02:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Deleted volume successfully. Jul 10 06:02:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [req-351ef582-fcde-486e-bd4c-5035682861ee req-2e5a0eb0-6272-46b8-bc57-e49583b170b8 tempest-TestShelveInstance-1837261439 None] Lock "cinder-e8cbafc1-0e28-47bc-98a0-8fa99c00e8f6-delete_volume" released by "delete_volume" :: held 5.555s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:15 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=1,cinder:UPDATE=8 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:02:16 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Flow 'volume_create_manager' (bb64d642-5650-4a74-99a3-e014c786eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23640be-b6b4-47a2-a852-dfd28ea4d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23640be-b6b4-47a2-a852-dfd28ea4d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7611cace7134c52a55a8fe3bf533757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:02:24Z,use_quota=True,user_id='f400805f248b4989943cae04d2205f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3474e49c-d8d3-4373-ac0c-3214ab6a1afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3474e49c-d8d3-4373-ac0c-3214ab6a1afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe33313-b53a-4891-98b3-846dd4033423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe33313-b53a-4891-98b3-846dd4033423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf', 'volume_name': 'volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf', 'volume_size': 1, 'image_id': '924826b8-9bc8-43db-953f-b0826727dc20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/924826b8-9bc8-43db-953f-b0826727dc20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8f18adfb1963428ccfae5dc666349c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7611cace7134c52a55a8fe3bf533757', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '80866dee42b1897a1efee976842a1dbc030816d169b008714909baa74f101a2c0da3ed2462b61d73f9a5f861fe367efe6ccd47dbf7c74fee761c6cd229e993cf', 'id': '924826b8-9bc8-43db-953f-b0826727dc20', 'created_at': datetime.datetime(2026, 7, 10, 4, 2, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 2, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/924826b8-9bc8-43db-953f-b0826727dc20/file', 'properties': {}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc563db-d400-42da-9df9-19c4c40b8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc563db-d400-42da-9df9-19c4c40b8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abfc57e-cc43-4017-b284-2785c181d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Volume ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf', 'volume_size': 1, 'image_id': '924826b8-9bc8-43db-953f-b0826727dc20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/924826b8-9bc8-43db-953f-b0826727dc20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8f18adfb1963428ccfae5dc666349c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7611cace7134c52a55a8fe3bf533757', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '80866dee42b1897a1efee976842a1dbc030816d169b008714909baa74f101a2c0da3ed2462b61d73f9a5f861fe367efe6ccd47dbf7c74fee761c6cd229e993cf', 'id': '924826b8-9bc8-43db-953f-b0826727dc20', 'created_at': datetime.datetime(2026, 7, 10, 4, 2, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 2, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/924826b8-9bc8-43db-953f-b0826727dc20/file', 'properties': {}}, 'image_service': } Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Trying to clone ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf from image 924826b8-9bc8-43db-953f-b0826727dc20 at location (None, [{'url': 'file:///opt/stack/data/glance/images/924826b8-9bc8-43db-953f-b0826727dc20', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:02:24 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:02:24 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:02:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84be263-ab71-433e-9e1b-d7dbc74c0e40]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:25 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD Jul 10 06:02:25 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:25 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:25 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD Jul 10 06:02:25 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c182acff-579f-43bf-80fb-9f6e00e84398]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:26 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 Jul 10 06:02:26 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:26 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD" returned: 1 in 0.782s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Temporary image 924826b8-9bc8-43db-953f-b0826727dc20 is fetched for user f400805f248b4989943cae04d2205f81. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0bf453-7e4a-4701-865e-e19eaca735bd]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:26 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD Jul 10 06:02:26 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:27 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.878s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-2dbcc2c1-bc3a-4374-805c-f536ed914345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a39c277e-df6f-4888-9f27-3fcf13c5e943', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:02:27 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD" returned: 0 in 0.780s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-a8de11c0-8185-4dc8-a4ce-d5419012f325 req-264faa0e-b8a8-48e8-9caa-ff820410092b tempest-TestInstancesWithCinderVolumes-2087837060 None] attachment_update completed successfully. Jul 10 06:02:27 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD Jul 10 06:02:27 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:28 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD" returned: 1 in 0.774s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7611cace7134c52a55a8fe3bf533757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:02:24Z,use_quota=True,user_id='f400805f248b4989943cae04d2205f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Creating volume ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:02:28 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:28 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf 1073741824 Jul 10 06:02:28 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:28 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:02:28 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:29 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf 1073741824" returned: 0 in 1.090s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:29 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:29 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:29 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:02:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:02:30 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 0 in 0.664s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Attempting download of 924826b8-9bc8-43db-953f-b0826727dc20 ((None, [{'url': 'file:///opt/stack/data/glance/images/924826b8-9bc8-43db-953f-b0826727dc20', 'metadata': {}}])) to volume ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6691ec9e-ead3-437d-9435-512252797d1d]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:30 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe Jul 10 06:02:30 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:30 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe" returned: 0 in 0.755s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:31 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe Jul 10 06:02:31 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:31 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe" returned: 1 in 0.785s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_924826b8-9bc8-43db-953f-b0826727dc20_sobrziwe' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a98640c-ae7d-415f-92d4-9cf11525a1de]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:31 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD Jul 10 06:02:31 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:32 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:32 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD Jul 10 06:02:32 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:33 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD" returned: 1 in 0.769s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:33 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] 924826b8-9bc8-43db-953f-b0826727dc20 was raw, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:02:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:33 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:33 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:34 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 0 in 0.786s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:34 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_924826b8-9bc8-43db-953f-b0826727dc20_w9mz2dp1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:02:34 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:02:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:34 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf 1G Jul 10 06:02:34 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:34 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf 1G" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:34 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0935e-981e-4e26-b7fe-6c8f0677cd6b]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:35 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:35 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c2bcd-1649-460f-baa6-3f8580147f42]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:35 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 Jul 10 06:02:35 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:35 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 0 in 0.832s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:35 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:35 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:36 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4" returned: 0 in 0.847s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-b4a8c053-bbbf-4241-838f-a03267832fe4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58a77301-1b66-4f96-b1da-8bed63da03cc', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:02:36 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-29c56822-3037-4392-9708-288d33368de7 req-0eebae22-ce60-4d30-80a4-a73ddd8c5447 tempest-TestInstancesWithCinderVolumes-2087837060 None] attachment_update completed successfully. Jul 10 06:02:36 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 1 in 0.876s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Downloaded image 924826b8-9bc8-43db-953f-b0826727dc20 ((None, [{'url': 'file:///opt/stack/data/glance/images/924826b8-9bc8-43db-953f-b0826727dc20', 'metadata': {}}])) to volume ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Temporary image 924826b8-9bc8-43db-953f-b0826727dc20 for user f400805f248b4989943cae04d2205f81 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Marking volume ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Copying metadata from image 924826b8-9bc8-43db-953f-b0826727dc20 to ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Creating volume glance metadata for volume ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf backed by image 924826b8-9bc8-43db-953f-b0826727dc20 with: {'image_id': '924826b8-9bc8-43db-953f-b0826727dc20', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c8f18adfb1963428ccfae5dc666349c0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abfc57e-cc43-4017-b284-2785c181d79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf', 'volume_size': 1, 'image_id': '924826b8-9bc8-43db-953f-b0826727dc20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/924826b8-9bc8-43db-953f-b0826727dc20', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8f18adfb1963428ccfae5dc666349c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c7611cace7134c52a55a8fe3bf533757', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '80866dee42b1897a1efee976842a1dbc030816d169b008714909baa74f101a2c0da3ed2462b61d73f9a5f861fe367efe6ccd47dbf7c74fee761c6cd229e993cf', 'id': '924826b8-9bc8-43db-953f-b0826727dc20', 'created_at': datetime.datetime(2026, 7, 10, 4, 2, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 2, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/924826b8-9bc8-43db-953f-b0826727dc20/file', 'properties': {}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a5d433-0aeb-47a4-a095-a0f2499ae25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:36 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Volume volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf (ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf): created successfully Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a5d433-0aeb-47a4-a095-a0f2499ae25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:36 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Flow 'volume_create_manager' (bb64d642-5650-4a74-99a3-e014c786eb90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:02:36 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-af2048cd-726a-4421-ad39-437f7b1ab004 tempest-VolumeImageDependencyTests-59521045 None] Created volume successfully. Jul 10 06:02:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Acquiring lock "cinder-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Lock "cinder-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Acquiring lock "cinder-quobyte-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Lock "cinder-quobyte-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4852d68f-2491-49e2-9376-1bfcb6ce6c21]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:37 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:37 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:38 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:38 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:38 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:39 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 1 in 0.773s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:39 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf Jul 10 06:02:39 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:39 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" returned: 0 in 0.652s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Lock "cinder-quobyte-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf" released by "delete_volume" :: held 2.320s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Created reservations ['24911f63-b603-42ad-bcd0-4d5c858688dc', 'd3fb32e1-cfe7-4e92-9f75-253450b14c36', '1effbc00-6a58-469a-9c33-a96b681b3ab6', 'b72c4196-d79a-4bf7-b446-78b224411ad4'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:39 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:02:39 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:40 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.814s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:02:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Deleted volume successfully. Jul 10 06:02:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6d774bae-ee0e-4f04-9ba8-9ddffd33b241 tempest-VolumeImageDependencyTests-59521045 None] Lock "cinder-ef7b664b-c3f3-4de9-9bae-bb09bf12eeaf-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Flow 'volume_create_manager' (6dd5451a-89e8-4166-82fc-342d9a5b93f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b37569-8db7-4e49-b6f9-b564895dd684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b37569-8db7-4e49-b6f9-b564895dd684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-844974984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aef37ad-271d-4cc1-a90f-cf4f35f78721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751408f6498f4cd8ae20c635b16dc154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:02:45Z,use_quota=True,user_id='fff96cdb3a9f40e19df5631f3a75eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1b0c3a-6919-47b4-8990-45239398c442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1b0c3a-6919-47b4-8990-45239398c442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b7c6fe-217b-4e3b-b199-83b155f2cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b7c6fe-217b-4e3b-b199-83b155f2cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aef37ad-271d-4cc1-a90f-cf4f35f78721', 'volume_name': 'volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52c11e0-e3f7-4e39-b4e5-83784a420fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52c11e0-e3f7-4e39-b4e5-83784a420fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7265d9b5-d567-4572-931b-8180a3cc1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Volume 7aef37ad-271d-4cc1-a90f-cf4f35f78721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721', 'volume_size': 1} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-844974984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aef37ad-271d-4cc1-a90f-cf4f35f78721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751408f6498f4cd8ae20c635b16dc154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:02:45Z,use_quota=True,user_id='fff96cdb3a9f40e19df5631f3a75eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Creating volume 7aef37ad-271d-4cc1-a90f-cf4f35f78721 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:02:44 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:02:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:44 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 1073741824 Jul 10 06:02:44 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Flow 'volume_create_manager' (a74266e0-edd5-465c-aba5-e24ff3d9587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7a5102-c051-46ab-8923-29d087a3f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7a5102-c051-46ab-8923-29d087a3f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-489549269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473d4f3c-16a7-4616-9c75-779e4610d1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751408f6498f4cd8ae20c635b16dc154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:02:45Z,use_quota=True,user_id='fff96cdb3a9f40e19df5631f3a75eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e3799f-c08a-4e88-a04a-e21c2e279bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e3799f-c08a-4e88-a04a-e21c2e279bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54a0458-fb91-4e56-b103-7eefb5221365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54a0458-fb91-4e56-b103-7eefb5221365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '473d4f3c-16a7-4616-9c75-779e4610d1a8', 'volume_name': 'volume-473d4f3c-16a7-4616-9c75-779e4610d1a8', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da6796a-2ac6-46d4-8c3b-bf74dc871c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da6796a-2ac6-46d4-8c3b-bf74dc871c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d464e9-ea46-4571-bedb-f91801015fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:45 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Volume 473d4f3c-16a7-4616-9c75-779e4610d1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-473d4f3c-16a7-4616-9c75-779e4610d1a8', 'volume_size': 1} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:45 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 1073741824" returned: 0 in 1.021s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:45 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 Jul 10 06:02:45 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-5fe34c5a-adc2-4dac-ac77-32cd184fbc2c req-e5791601-52e2-4ec2-bfe8-be274c9339c2 tempest-TestInstancesWithCinderVolumes-2087837060 None] Terminate volume connection completed successfully. Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-5fe34c5a-adc2-4dac-ac77-32cd184fbc2c req-e5791601-52e2-4ec2-bfe8-be274c9339c2 tempest-TestInstancesWithCinderVolumes-2087837060 None] Deleting attachment a39c277e-df6f-4888-9f27-3fcf13c5e943. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:02:46 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-489549269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473d4f3c-16a7-4616-9c75-779e4610d1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751408f6498f4cd8ae20c635b16dc154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:02:45Z,use_quota=True,user_id='fff96cdb3a9f40e19df5631f3a75eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Creating volume 473d4f3c-16a7-4616-9c75-779e4610d1a8 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:02:46 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7265d9b5-d567-4572-931b-8180a3cc1059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:46 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 1073741824 Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8b65d2-4d2a-45ca-87f8-5276c86f70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:46 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Volume volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 (7aef37ad-271d-4cc1-a90f-cf4f35f78721): created successfully Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8b65d2-4d2a-45ca-87f8-5276c86f70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Flow 'volume_create_manager' (6dd5451a-89e8-4166-82fc-342d9a5b93f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:02:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-19201181-33fb-4cb2-afc1-4321ed599ec1 tempest-TestServerVolumeAttachmentScenario-751858774 None] Created volume successfully. Jul 10 06:02:47 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 1073741824" returned: 0 in 0.868s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:47 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 Jul 10 06:02:47 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "cinder-2dbcc2c1-bc3a-4374-805c-f536ed914345-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-2dbcc2c1-bc3a-4374-805c-f536ed914345-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "cinder-quobyte-2dbcc2c1-bc3a-4374-805c-f536ed914345" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-quobyte-2dbcc2c1-bc3a-4374-805c-f536ed914345" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:48 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d464e9-ea46-4571-bedb-f91801015fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-473d4f3c-16a7-4616-9c75-779e4610d1a8', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad7bbd8-a021-43c9-8aad-c342ff45287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fa34d1-960d-4518-b4db-a82e32a5bd05]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:48 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Volume volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 (473d4f3c-16a7-4616-9c75-779e4610d1a8): created successfully Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad7bbd8-a021-43c9-8aad-c342ff45287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:02:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Flow 'volume_create_manager' (a74266e0-edd5-465c-aba5-e24ff3d9587e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:02:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4191530f-4920-4df9-ba12-8f4ea4c78e67 tempest-TestServerVolumeAttachmentScenario-751858774 None] Created volume successfully. Jul 10 06:02:48 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 Jul 10 06:02:48 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:49 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345" returned: 0 in 0.805s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:49 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345 Jul 10 06:02:49 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:49 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2dbcc2c1-bc3a-4374-805c-f536ed914345" returned: 0 in 0.719s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-quobyte-2dbcc2c1-bc3a-4374-805c-f536ed914345" released by "delete_volume" :: held 1.579s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:49 devstack cinder-volume[87449]: WARNING cinder.quota [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109651540-1100821037 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109651540-1100821037, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:02:49 devstack cinder-volume[87449]: WARNING cinder.quota [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109651540-1100821037 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109651540-1100821037, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Created reservations ['1e075ee3-eb6e-49bb-9760-403889cba771', 'f59fc0e6-87b2-4b73-a244-3c0fe44dc1ba', '06c562b0-212c-401e-ae0e-f39b179b77e2', '201490c0-3635-4387-ac21-cf9e084ecab4'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:49 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:02:49 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:50 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.663s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:50 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:02:50 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Deleted volume successfully. Jul 10 06:02:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-45633afa-0474-49d4-8e05-05a9cc395afe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-2dbcc2c1-bc3a-4374-805c-f536ed914345-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-a3fa3393-92bc-4aba-9e67-3181b444f66d req-32319552-481e-415b-8daa-7d59ad911173 tempest-TestInstancesWithCinderVolumes-2087837060 None] Terminate volume connection completed successfully. Jul 10 06:02:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-a3fa3393-92bc-4aba-9e67-3181b444f66d req-32319552-481e-415b-8daa-7d59ad911173 tempest-TestInstancesWithCinderVolumes-2087837060 None] Deleting attachment 58a77301-1b66-4f96-b1da-8bed63da03cc. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:02:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "cinder-b4a8c053-bbbf-4241-838f-a03267832fe4-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-b4a8c053-bbbf-4241-838f-a03267832fe4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "cinder-quobyte-b4a8c053-bbbf-4241-838f-a03267832fe4" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:02:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-quobyte-b4a8c053-bbbf-4241-838f-a03267832fe4" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:02:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[545c5d93-8d31-41c1-80b8-6a8e8bf52d9e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:02:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:54 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 Jul 10 06:02:54 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:54 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4" returned: 0 in 0.916s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:54 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4 Jul 10 06:02:54 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:55 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b4a8c053-bbbf-4241-838f-a03267832fe4" returned: 0 in 0.745s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-quobyte-b4a8c053-bbbf-4241-838f-a03267832fe4" released by "delete_volume" :: held 1.768s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:02:55 devstack cinder-volume[87449]: WARNING cinder.quota [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1809423416-524337961 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1809423416-524337961, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:02:55 devstack cinder-volume[87449]: WARNING cinder.quota [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1809423416-524337961 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1809423416-524337961, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Created reservations ['44103574-1b0d-4d1a-abab-d4f68d6d4f4a', 'ba960936-1739-4677-ad94-4a7318a56ab6', '3888504a-9272-4455-bba6-baaf7c52e01a', '96e7226e-9808-4e94-933d-36a994505e70'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:02:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:02:55 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:02:55 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:02:56 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 10 06:02:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.761s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:02:56 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:02:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Deleted volume successfully. Jul 10 06:02:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30752796-81a1-4f27-847c-16b43628819b tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-b4a8c053-bbbf-4241-838f-a03267832fe4-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:03:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-7d7f80f4-14e8-4e8d-a2d6-cb23676aea97 req-e6113be7-c825-40af-a8b2-eb5e1f763576 tempest-TestInstancesWithCinderVolumes-2087837060 None] Terminate volume connection completed successfully. Jul 10 06:03:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-7d7f80f4-14e8-4e8d-a2d6-cb23676aea97 req-e6113be7-c825-40af-a8b2-eb5e1f763576 tempest-TestInstancesWithCinderVolumes-2087837060 None] Deleting attachment 9ca50d42-4a4e-47b5-8510-1369b67a1ff1. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:03:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "cinder-c3141f08-a4e3-4de6-b52e-04e69b1abe2b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:03:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-c3141f08-a4e3-4de6-b52e-04e69b1abe2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:03:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "cinder-quobyte-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:03:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-quobyte-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:03:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[12162a56-9fb1-4324-909d-25b900ad4cb0]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:03:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:04 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:03:04 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:05 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 0 in 0.846s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:05 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:03:05 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:06 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 1 in 1.023s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:03:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:06 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b Jul 10 06:03:06 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:06 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" returned: 0 in 0.706s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-quobyte-c3141f08-a4e3-4de6-b52e-04e69b1abe2b" released by "delete_volume" :: held 2.727s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:03:07 devstack cinder-volume[87449]: WARNING cinder.quota [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1457003373-184342863 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1457003373-184342863, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:03:07 devstack cinder-volume[87449]: WARNING cinder.quota [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1457003373-184342863 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1457003373-184342863, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Created reservations ['87974aec-8613-4af9-b997-3fbb976dce52', 'b77861dc-acb8-475a-a755-f7b88af84fa4', 'c3ea87fd-609a-457a-b775-b00a136abbb0', '4aedb367-498e-4f56-860d-7b77e0660394'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:07 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:03:07 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:07 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:03:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Deleted volume successfully. Jul 10 06:03:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ebe33dd-60f2-49d4-b253-1f789d4af6fe tempest-TestInstancesWithCinderVolumes-2087837060 None] Lock "cinder-c3141f08-a4e3-4de6-b52e-04e69b1abe2b-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:03:17 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=58,cinder:SELECT=44,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:03:17 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=48,cinder:UPDATE=34,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:03:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:03:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:03:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ace40a-a705-49b1-973b-ca17f8998298]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:03:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:28 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 Jul 10 06:03:28 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:28 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721" returned: 0 in 0.765s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.783s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a8975de-a13d-4fc4-89b5-ec165ca55bb7', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:03:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-16b47564-0844-4c50-8343-8de97dac816e req-7694f316-fa41-4e25-ac67-aed3ed6c4bb9 tempest-TestServerVolumeAttachmentScenario-751858774 None] attachment_update completed successfully. Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:03:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:28 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:03:28 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:29 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.703s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:03:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:03:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:03:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:03:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:03:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:03:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[11478ce2-cb42-4f8a-81ce-22d86712853b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:03:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:38 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 Jul 10 06:03:38 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:38 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:03:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-473d4f3c-16a7-4616-9c75-779e4610d1a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ff34f02-ccd6-4b23-b02d-1bc244f53d22', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:03:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-c2415554-437e-4060-8bf0-a1341c92b7f7 req-0bed4384-585b-460d-a339-982dbe471ff3 tempest-TestServerVolumeAttachmentScenario-751858774 None] attachment_update completed successfully. Jul 10 06:03:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-fe7297f2-4fd0-4223-8e8c-8d6a09aa8ddb req-b4aa9d9d-a132-40f9-8a53-a5dd572fb8c5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Terminate volume connection completed successfully. Jul 10 06:03:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-fe7297f2-4fd0-4223-8e8c-8d6a09aa8ddb req-b4aa9d9d-a132-40f9-8a53-a5dd572fb8c5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Deleting attachment 3ff34f02-ccd6-4b23-b02d-1bc244f53d22. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:03:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-eb5b4815-2f14-4f5f-9b85-e26f4ad028b7 req-9c8907c4-33b3-459d-8ecc-7489e996b4fa tempest-TestServerVolumeAttachmentScenario-751858774 None] Terminate volume connection completed successfully. Jul 10 06:03:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-eb5b4815-2f14-4f5f-9b85-e26f4ad028b7 req-9c8907c4-33b3-459d-8ecc-7489e996b4fa tempest-TestServerVolumeAttachmentScenario-751858774 None] Deleting attachment 6a8975de-a13d-4fc4-89b5-ec165ca55bb7. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Flow 'volume_create_manager' (8772542d-11ad-46bd-9f3b-e57777478b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd5684e-d79e-4e16-b283-e41b1d061e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd5684e-d79e-4e16-b283-e41b1d061e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-479149279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25841284-004b-415b-915b-40cf4c3d463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a342ec00cf534fecba4c75f0aad26c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:03:56Z,use_quota=True,user_id='e9ebbddd3d0341399e3861a5bd67fbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2fe9db-6220-4257-a0ac-2984d6e16425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2fe9db-6220-4257-a0ac-2984d6e16425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb59dce7-3b20-489a-9bcd-a8fcefc2b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb59dce7-3b20-489a-9bcd-a8fcefc2b717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25841284-004b-415b-915b-40cf4c3d463a', 'volume_name': 'volume-25841284-004b-415b-915b-40cf4c3d463a', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed614282-42b6-44ff-a314-c0367f09b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed614282-42b6-44ff-a314-c0367f09b188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdd2664-60e7-4bfd-9463-0e219781f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:03:55 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Volume 25841284-004b-415b-915b-40cf4c3d463a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25841284-004b-415b-915b-40cf4c3d463a', 'volume_size': 1} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-479149279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25841284-004b-415b-915b-40cf4c3d463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a342ec00cf534fecba4c75f0aad26c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:03:56Z,use_quota=True,user_id='e9ebbddd3d0341399e3861a5bd67fbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Creating volume 25841284-004b-415b-915b-40cf4c3d463a {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:03:55 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:03:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:55 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a 1073741824 Jul 10 06:03:55 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:56 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a 1073741824" returned: 0 in 0.824s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:56 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a Jul 10 06:03:56 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:03:57 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a" returned: 0 in 0.674s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdd2664-60e7-4bfd-9463-0e219781f249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25841284-004b-415b-915b-40cf4c3d463a', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c9ca4b-8f7f-4f83-a10a-5ee2e9c2fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:03:57 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Volume volume-25841284-004b-415b-915b-40cf4c3d463a (25841284-004b-415b-915b-40cf4c3d463a): created successfully Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c9ca4b-8f7f-4f83-a10a-5ee2e9c2fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:03:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Flow 'volume_create_manager' (8772542d-11ad-46bd-9f3b-e57777478b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:03:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1b281c05-34b9-40dc-89bf-b3fb1776de28 tempest-TestMinimumBasicScenario-943201652 None] Created volume successfully. Jul 10 06:03:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "cinder-473d4f3c-16a7-4616-9c75-779e4610d1a8-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:03:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-473d4f3c-16a7-4616-9c75-779e4610d1a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:03:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "cinder-quobyte-473d4f3c-16a7-4616-9c75-779e4610d1a8" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:03:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-quobyte-473d4f3c-16a7-4616-9c75-779e4610d1a8" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:03:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[56205753-7504-43eb-8f7d-36f2d6d8653a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:03:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:03:59 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 Jul 10 06:03:59 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:00 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8" returned: 0 in 0.822s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:00 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8 Jul 10 06:04:00 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:00 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-473d4f3c-16a7-4616-9c75-779e4610d1a8" returned: 0 in 0.697s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-quobyte-473d4f3c-16a7-4616-9c75-779e4610d1a8" released by "delete_volume" :: held 1.565s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:00 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Created reservations ['86e15438-a7d7-406b-b85e-978ceb3bcc42', '7434c847-10f4-4fad-ac26-9ecadafeb551', 'f6e472fb-ca45-44d0-abd2-e2e373fc36e3', '7e1b6d4a-a45a-4d54-92f7-64682f8abe3e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:01 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:01 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba4b5c-6853-48e1-9306-4fb932760699]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "cinder-7aef37ad-271d-4cc1-a90f-cf4f35f78721-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:01 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a Jul 10 06:04:01 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-7aef37ad-271d-4cc1-a90f-cf4f35f78721-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "cinder-quobyte-7aef37ad-271d-4cc1-a90f-cf4f35f78721" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-quobyte-7aef37ad-271d-4cc1-a90f-cf4f35f78721" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a589d3b-3d0d-4764-9d62-1ad74165b943]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:01 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 Jul 10 06:04:01 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:01 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.851s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Deleted volume successfully. Jul 10 06:04:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7c4cb652-97cf-4e22-80f3-1644fcf297e5 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-473d4f3c-16a7-4616-9c75-779e4610d1a8-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:02 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a" returned: 0 in 0.949s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d', 'name': 'volume-25841284-004b-415b-915b-40cf4c3d463a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6694958f-31ea-47b9-ba3c-779f539e8234', 'enforce_multipath': True} {{(pid=87449) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:04:02 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721" returned: 0 in 0.906s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:02 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721 Jul 10 06:04:02 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-ae74c538-c3b4-44f7-b3be-db635efa5174 req-f59af65b-328b-47fd-b8c5-bd15d1574809 tempest-TestMinimumBasicScenario-943201652 None] attachment_update completed successfully. Jul 10 06:04:03 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7aef37ad-271d-4cc1-a90f-cf4f35f78721" returned: 0 in 0.715s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-quobyte-7aef37ad-271d-4cc1-a90f-cf4f35f78721" released by "delete_volume" :: held 1.675s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Created reservations ['c79646dd-a864-4649-a53b-38e7addb239b', '5cfd2754-ae09-4f01-b3b4-6cf974f4e3ae', 'c5f23e7d-5a2f-46a4-bec5-d7b824316425', '856403f4-5fd1-42fd-84d4-a787108de29b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:03 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:03 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:04 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.705s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:04 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Deleted volume successfully. Jul 10 06:04:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b1d10718-0b7a-4afa-bc51-66b41e0e4b55 tempest-TestServerVolumeAttachmentScenario-751858774 None] Lock "cinder-7aef37ad-271d-4cc1-a90f-cf4f35f78721-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:13 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:04:14 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=34,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Flow 'volume_create_manager' (d8508841-27d6-4679-b56d-12db299a898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19def996-8dbe-48fe-abed-001f94406aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19def996-8dbe-48fe-abed-001f94406aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e25c74-fa58-4850-b54c-11cc8c3a2256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d304727bdff34739b0946843237281b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:18Z,use_quota=True,user_id='701db47dd4984177aaeba122b73c8e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a784fd-0118-4406-b4f2-ac01793dd27a),volume_type_id=c1a784fd-0118-4406-b4f2-ac01793dd27a)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf6869a-fb83-4b6e-8356-bfdc9d6827db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf6869a-fb83-4b6e-8356-bfdc9d6827db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00de5f31-7cda-4fb1-98e4-d500174a2b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:17 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00de5f31-7cda-4fb1-98e4-d500174a2b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3e25c74-fa58-4850-b54c-11cc8c3a2256', 'volume_name': 'volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256', 'volume_size': 1, 'image_id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9a981bc576c6fac6bf122586367409e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd304727bdff34739b0946843237281b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df2d86c452434525a158a8f5796f49d4ca3697535f884be802f409768d524775f0db44c44b3b8b5af73d84e8abbce65ffda642329a4238ef461f6e1a3d36bbd5', 'id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'created_at': datetime.datetime(2026, 7, 10, 4, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 4, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec802804-d6ea-44f3-94af-d8994e2ebe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec802804-d6ea-44f3-94af-d8994e2ebe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9698f85-8fe9-408f-a25d-997d99c9e69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Volume b3e25c74-fa58-4850-b54c-11cc8c3a2256: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256', 'volume_size': 1, 'image_id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9a981bc576c6fac6bf122586367409e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd304727bdff34739b0946843237281b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df2d86c452434525a158a8f5796f49d4ca3697535f884be802f409768d524775f0db44c44b3b8b5af73d84e8abbce65ffda642329a4238ef461f6e1a3d36bbd5', 'id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'created_at': datetime.datetime(2026, 7, 10, 4, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 4, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Trying to clone b3e25c74-fa58-4850-b54c-11cc8c3a2256 from image f2481b7d-a89b-4705-b6b8-0da3d7dd07bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:04:18 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f17232-d720-4eef-a490-e3e139f06692]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:18 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD Jul 10 06:04:18 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:19 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:19 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD Jul 10 06:04:19 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:19 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD" returned: 1 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Temporary image f2481b7d-a89b-4705-b6b8-0da3d7dd07bb is fetched for user 701db47dd4984177aaeba122b73c8e2f. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a535c6fe-3e86-4acd-8a74-749cfb23ad68]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:20 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD Jul 10 06:04:20 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:20 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:20 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD Jul 10 06:04:20 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:21 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e25c74-fa58-4850-b54c-11cc8c3a2256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d304727bdff34739b0946843237281b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:18Z,use_quota=True,user_id='701db47dd4984177aaeba122b73c8e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a784fd-0118-4406-b4f2-ac01793dd27a),volume_type_id=c1a784fd-0118-4406-b4f2-ac01793dd27a)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Creating volume b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:21 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:21 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 1073741824 Jul 10 06:04:21 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:22 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 1073741824" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:22 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:22 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:22 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 0 in 0.670s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Attempting download of f2481b7d-a89b-4705-b6b8-0da3d7dd07bb ((None, [{'url': 'file:///opt/stack/data/glance/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'metadata': {}}])) to volume b3e25c74-fa58-4850-b54c-11cc8c3a2256. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7067f4e1-1a05-43fe-aeb9-3d7bf59c89f8]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:23 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u Jul 10 06:04:23 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:23 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u" returned: 0 in 0.716s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:23 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u Jul 10 06:04:23 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:24 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u" returned: 1 in 0.735s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_n_1vee_u' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:04:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[17147b74-4ecf-4522-9db2-ada3599ba34e]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:24 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD Jul 10 06:04:24 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:25 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:25 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD Jul 10 06:04:25 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:25 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD" returned: 1 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:04:25 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] f2481b7d-a89b-4705-b6b8-0da3d7dd07bb was raw, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:04:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:25 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:25 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:26 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:26 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f2481b7d-a89b-4705-b6b8-0da3d7dd07bb_u875a1ghdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:04:26 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:04:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:26 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 1G Jul 10 06:04:26 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:27 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 1G" returned: 0 in 0.676s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d1259-d3a3-4240-ba79-2a622c1f95ea]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:27 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:27 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:28 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 0 in 0.761s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:28 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:28 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:28 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 1 in 0.747s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Downloaded image f2481b7d-a89b-4705-b6b8-0da3d7dd07bb ((None, [{'url': 'file:///opt/stack/data/glance/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'metadata': {}}])) to volume b3e25c74-fa58-4850-b54c-11cc8c3a2256 successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Temporary image f2481b7d-a89b-4705-b6b8-0da3d7dd07bb for user 701db47dd4984177aaeba122b73c8e2f is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Marking volume b3e25c74-fa58-4850-b54c-11cc8c3a2256 as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:04:28 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:28 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Copying metadata from image f2481b7d-a89b-4705-b6b8-0da3d7dd07bb to b3e25c74-fa58-4850-b54c-11cc8c3a2256. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:04:28 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Creating volume glance metadata for volume b3e25c74-fa58-4850-b54c-11cc8c3a2256 backed by image f2481b7d-a89b-4705-b6b8-0da3d7dd07bb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a9a981bc576c6fac6bf122586367409e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9698f85-8fe9-408f-a25d-997d99c9e69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256', 'volume_size': 1, 'image_id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9a981bc576c6fac6bf122586367409e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd304727bdff34739b0946843237281b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df2d86c452434525a158a8f5796f49d4ca3697535f884be802f409768d524775f0db44c44b3b8b5af73d84e8abbce65ffda642329a4238ef461f6e1a3d36bbd5', 'id': 'f2481b7d-a89b-4705-b6b8-0da3d7dd07bb', 'created_at': datetime.datetime(2026, 7, 10, 4, 4, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 4, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2481b7d-a89b-4705-b6b8-0da3d7dd07bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd46f672-7617-4c5f-b597-27d9b8bdf0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:29 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Volume volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 (b3e25c74-fa58-4850-b54c-11cc8c3a2256): created successfully Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd46f672-7617-4c5f-b597-27d9b8bdf0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Flow 'volume_create_manager' (d8508841-27d6-4679-b56d-12db299a898c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6ccf54eb-79a7-41dc-a524-cd349bd8d580 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Created volume successfully. Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Acquiring lock "cinder-b3e25c74-fa58-4850-b54c-11cc8c3a2256-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "cinder-b3e25c74-fa58-4850-b54c-11cc8c3a2256-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:29 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.729s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Acquiring lock "cinder-quobyte-b3e25c74-fa58-4850-b54c-11cc8c3a2256" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "cinder-quobyte-b3e25c74-fa58-4850-b54c-11cc8c3a2256" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[72749748-3b1c-411e-834c-cc2ef1f65963]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:29 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:29 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:30 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:30 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:30 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:31 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 1 in 0.738s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:04:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:31 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256 Jul 10 06:04:31 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:31 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3e25c74-fa58-4850-b54c-11cc8c3a2256" returned: 0 in 0.673s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "cinder-quobyte-b3e25c74-fa58-4850-b54c-11cc8c3a2256" released by "delete_volume" :: held 2.245s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:31 devstack cinder-volume[87449]: WARNING cinder.quota [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:04:31 devstack cinder-volume[87449]: WARNING cinder.quota [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:04:31 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Created reservations ['4870a217-55f5-49fc-ad92-ed3f5fe5dad5', '787a4c71-4f3d-4e4f-ad51-799bea1f46da', '8406189a-ab62-465d-acdb-82a9589cfc1b', '004c4340-360d-483d-b7e0-135897536d8b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:32 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:32 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:32 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Deleted volume successfully. Jul 10 06:04:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ee7b1f9c-0df7-40e8-a942-7aeee4dd4245 tempest-VolumeAndVolumeTypeFromImageTest-767184650 None] Lock "cinder-b3e25c74-fa58-4850-b54c-11cc8c3a2256-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (37d0b5fa-c393-4333-84fb-940d22d20b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6ee26c-ceaa-4be3-ab1f-b6044e37a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6ee26c-ceaa-4be3-ab1f-b6044e37a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59861408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f7f393-5862-4b07-8a50-354c430f627e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:37Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde74c6d-e0c2-4e2e-8cbd-f9ea6e2cd103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde74c6d-e0c2-4e2e-8cbd-f9ea6e2cd103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079bc508-c1d1-4450-9574-85ea0278cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079bc508-c1d1-4450-9574-85ea0278cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f7f393-5862-4b07-8a50-354c430f627e', 'volume_name': 'volume-c7f7f393-5862-4b07-8a50-354c430f627e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cc7566-684f-4bf2-bdf1-32dc2cd33a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cc7566-684f-4bf2-bdf1-32dc2cd33a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a4ce35-76e2-4ac6-8591-d79968c2c6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume c7f7f393-5862-4b07-8a50-354c430f627e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f7f393-5862-4b07-8a50-354c430f627e', 'volume_size': 1} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59861408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f7f393-5862-4b07-8a50-354c430f627e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:37Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating volume c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:37 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:37 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e 1073741824 Jul 10 06:04:37 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:38 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e 1073741824" returned: 0 in 0.810s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:38 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e Jul 10 06:04:38 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:39 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e" returned: 0 in 0.632s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a4ce35-76e2-4ac6-8591-d79968c2c6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f7f393-5862-4b07-8a50-354c430f627e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee3f9a2-3b12-4e0f-9fb2-300b2d9714ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume volume-c7f7f393-5862-4b07-8a50-354c430f627e (c7f7f393-5862-4b07-8a50-354c430f627e): created successfully Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee3f9a2-3b12-4e0f-9fb2-300b2d9714ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (37d0b5fa-c393-4333-84fb-940d22d20b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-83446b4e-99a3-4b64-86b9-d07224d59d74 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created volume successfully. Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating offline snapshot bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 of volume c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07fc3dc-3352-41ed-8438-61c7881fd16a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:39 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e Jul 10 06:04:39 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:40 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e" returned: 0 in 0.739s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:40 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 1G Jul 10 06:04:40 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:41 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 1G" returned: 0 in 0.755s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f7f393-5862-4b07-8a50-354c430f627e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:41 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f7f393-5862-4b07-8a50-354c430f627e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 Jul 10 06:04:41 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:41 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f7f393-5862-4b07-8a50-354c430f627e -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" returned: 0 in 0.678s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:41 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 is being set with open permissions: ugo+rw Jul 10 06:04:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:41 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 Jul 10 06:04:41 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:42 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" returned: 0 in 0.645s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:42 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info Jul 10 06:04:42 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:43 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info" returned: 0 in 0.644s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:43 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info is being set with open permissions: ugo+rw Jul 10 06:04:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:43 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info Jul 10 06:04:43 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:43 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.info" returned: 0 in 0.644s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a9360bff-10a1-482e-a8e0-e3bdd0f3bc3c tempest-CreateVolumesFromSnapshotTest-1316292048 None] Create snapshot completed successfully Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (4c599278-b080-407a-9d7d-db70eec392bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc2b1bf-b00d-405d-9449-2b812af5a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc2b1bf-b00d-405d-9449-2b812af5a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018384819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e810bbf-269a-4438-9c0e-6bca4ed3f4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:45Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cda78bc-d22c-4a20-8c37-b3a9735a8c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cda78bc-d22c-4a20-8c37-b3a9735a8c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a4c20d-3d63-4076-ac1a-01080a1ad074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a4c20d-3d63-4076-ac1a-01080a1ad074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e810bbf-269a-4438-9c0e-6bca4ed3f4ac', 'volume_name': 'volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98bd68f-b882-4725-9d2a-3054944f7976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98bd68f-b882-4725-9d2a-3054944f7976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0726b1-5428-4357-8ba6-90e659470b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume 9e810bbf-269a-4438-9c0e-6bca4ed3f4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac', 'volume_size': 1} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018384819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e810bbf-269a-4438-9c0e-6bca4ed3f4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:45Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating volume 9e810bbf-269a-4438-9c0e-6bca4ed3f4ac {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:45 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:45 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac 1073741824 Jul 10 06:04:45 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (53647144-9d58-4a53-a1db-8928ea31eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20198f5-bb15-4c35-a4ef-59347c4b9e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20198f5-bb15-4c35-a4ef-59347c4b9e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284066687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89e7d67-6142-454d-8b46-69fd77d033c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:46Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e77e99a-f520-430d-8395-cb08cbbab20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e77e99a-f520-430d-8395-cb08cbbab20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb22fe43-2e58-44dd-a2e0-1dcb3a90e556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb22fe43-2e58-44dd-a2e0-1dcb3a90e556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89e7d67-6142-454d-8b46-69fd77d033c5', 'volume_name': 'volume-d89e7d67-6142-454d-8b46-69fd77d033c5', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3c5437-fe44-4cbe-8ca1-e91336c9c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3c5437-fe44-4cbe-8ca1-e91336c9c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3447c0cc-8b13-41df-bc98-98c115b366fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:45 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume d89e7d67-6142-454d-8b46-69fd77d033c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89e7d67-6142-454d-8b46-69fd77d033c5', 'volume_size': 1} Jul 10 06:04:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (21bb0bca-ed08-41e6-8f96-2ef6cd60cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0bc080-b2b5-4fa9-b65d-f88d62e74ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0bc080-b2b5-4fa9-b65d-f88d62e74ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508094073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc75e292-b48a-4858-809b-a865ff34548b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:46Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d0b425-c8e9-4031-aa78-27b726d90dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d0b425-c8e9-4031-aa78-27b726d90dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3a2f06-833b-4194-8ead-6c8fa9c31fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3a2f06-833b-4194-8ead-6c8fa9c31fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc75e292-b48a-4858-809b-a865ff34548b', 'volume_name': 'volume-bc75e292-b48a-4858-809b-a865ff34548b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fc8d95-7064-41da-a543-2b3143b2fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fc8d95-7064-41da-a543-2b3143b2fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1df718-f487-4653-bde8-c4c4462d3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume bc75e292-b48a-4858-809b-a865ff34548b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc75e292-b48a-4858-809b-a865ff34548b', 'volume_size': 1} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:46 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac 1073741824" returned: 0 in 1.118s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:46 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:46 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (27e7707a-3293-44fb-9276-0c08563d5e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3b0279-39f4-4c21-9b7d-0abbc5221a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3b0279-39f4-4c21-9b7d-0abbc5221a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1432886677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5e5d1c-944a-4aa1-99d9-79447d48e69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:47Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a927dc-2c07-4d3b-bfac-0f36b4d0e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a927dc-2c07-4d3b-bfac-0f36b4d0e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05858372-f0c7-4e3c-a8fb-e272fd6a6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05858372-f0c7-4e3c-a8fb-e272fd6a6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5e5d1c-944a-4aa1-99d9-79447d48e69e', 'volume_name': 'volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b6fb5c-8893-40b5-9ac7-8a11302bb1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b6fb5c-8893-40b5-9ac7-8a11302bb1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9e4f10-e6c2-47fc-b568-560571e0b853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume 3e5e5d1c-944a-4aa1-99d9-79447d48e69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e', 'volume_size': 1} Jul 10 06:04:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (70906f37-0481-4ccf-af70-a5728fee3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a3bd67-145f-4798-aaea-264142b08296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a3bd67-145f-4798-aaea-264142b08296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-748037698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68681313-4532-492a-8850-159651949302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:47Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bdc439-8390-473a-bcc9-4d8ef4de43de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bdc439-8390-473a-bcc9-4d8ef4de43de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335941a2-5b2b-4989-90a4-ee1c347abba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335941a2-5b2b-4989-90a4-ee1c347abba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68681313-4532-492a-8850-159651949302', 'volume_name': 'volume-68681313-4532-492a-8850-159651949302', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146728ce-cee1-4691-a046-20d322de4d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146728ce-cee1-4691-a046-20d322de4d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c25341e-3619-46ef-9fb9-9c0a169bd678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:47 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume 68681313-4532-492a-8850-159651949302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68681313-4532-492a-8850-159651949302', 'volume_size': 1} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:47 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac" returned: 0 in 0.791s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284066687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89e7d67-6142-454d-8b46-69fd77d033c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:46Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating volume d89e7d67-6142-454d-8b46-69fd77d033c5 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:47 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:47 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 1073741824 Jul 10 06:04:47 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0726b1-5428-4357-8ba6-90e659470b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045ba059-0375-497a-8510-5a009c14d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:47 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac (9e810bbf-269a-4438-9c0e-6bca4ed3f4ac): created successfully Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045ba059-0375-497a-8510-5a009c14d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (4c599278-b080-407a-9d7d-db70eec392bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-af500367-3274-4ddf-99a4-1b30a717cbe1 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created volume successfully. Jul 10 06:04:48 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 1073741824" returned: 0 in 0.909s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:48 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 Jul 10 06:04:48 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:49 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5" returned: 0 in 0.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.818s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508094073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc75e292-b48a-4858-809b-a865ff34548b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:46Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating volume bc75e292-b48a-4858-809b-a865ff34548b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:49 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:49 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b 1073741824 Jul 10 06:04:49 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3447c0cc-8b13-41df-bc98-98c115b366fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89e7d67-6142-454d-8b46-69fd77d033c5', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61458bd0-0304-466d-9e9f-cb55db2e5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:49 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume volume-d89e7d67-6142-454d-8b46-69fd77d033c5 (d89e7d67-6142-454d-8b46-69fd77d033c5): created successfully Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61458bd0-0304-466d-9e9f-cb55db2e5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (53647144-9d58-4a53-a1db-8928ea31eb60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d8cb26ad-9123-4922-bcd0-6f65b3980b5b tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created volume successfully. Jul 10 06:04:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [req-b417dea2-79c6-40e2-9657-94f741487333 req-79223f73-907c-4ec8-a11d-50b4951f7726 tempest-TestMinimumBasicScenario-943201652 None] Terminate volume connection completed successfully. Jul 10 06:04:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [req-b417dea2-79c6-40e2-9657-94f741487333 req-79223f73-907c-4ec8-a11d-50b4951f7726 tempest-TestMinimumBasicScenario-943201652 None] Deleting attachment 6694958f-31ea-47b9-ba3c-779f539e8234. {{(pid=87449) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:04:50 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b 1073741824" returned: 0 in 0.876s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:50 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b Jul 10 06:04:50 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:50 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b" returned: 0 in 0.654s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.880s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1432886677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5e5d1c-944a-4aa1-99d9-79447d48e69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:47Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating volume 3e5e5d1c-944a-4aa1-99d9-79447d48e69e {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:50 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1df718-f487-4653-bde8-c4c4462d3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc75e292-b48a-4858-809b-a865ff34548b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:50 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e 1073741824 Jul 10 06:04:50 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b8edea-4c30-4d32-9172-5d930f18478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:50 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume volume-bc75e292-b48a-4858-809b-a865ff34548b (bc75e292-b48a-4858-809b-a865ff34548b): created successfully Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b8edea-4c30-4d32-9172-5d930f18478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (21bb0bca-ed08-41e6-8f96-2ef6cd60cc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:50 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2a5f9b96-96b1-487a-ac8d-51d272438d78 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created volume successfully. Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Acquiring lock "cinder-25841284-004b-415b-915b-40cf4c3d463a-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Lock "cinder-25841284-004b-415b-915b-40cf4c3d463a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Acquiring lock "cinder-quobyte-25841284-004b-415b-915b-40cf4c3d463a" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Lock "cinder-quobyte-25841284-004b-415b-915b-40cf4c3d463a" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d772f2c2-a95a-48a3-8521-f5d7e4e8dfbb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:51 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a Jul 10 06:04:51 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:51 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e 1073741824" returned: 0 in 0.904s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:51 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e Jul 10 06:04:51 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:52 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:52 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a Jul 10 06:04:52 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:52 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e" returned: 0 in 0.706s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.225s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-748037698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68681313-4532-492a-8850-159651949302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a534e9a1412f4219b94be043b1b04364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:04:47Z,use_quota=True,user_id='a4c237b4e4a849c2b64805138c0ee11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Creating volume 68681313-4532-492a-8850-159651949302 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:04:52 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:52 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 1073741824 Jul 10 06:04:52 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9e4f10-e6c2-47fc-b568-560571e0b853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd73648-c5ae-4ff3-8c97-714591da0edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e (3e5e5d1c-944a-4aa1-99d9-79447d48e69e): created successfully Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd73648-c5ae-4ff3-8c97-714591da0edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (27e7707a-3293-44fb-9276-0c08563d5e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a45b71d8-9e45-4c23-bd93-984cd8762259 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created volume successfully. Jul 10 06:04:52 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-25841284-004b-415b-915b-40cf4c3d463a" returned: 0 in 0.685s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Lock "cinder-quobyte-25841284-004b-415b-915b-40cf4c3d463a" released by "delete_volume" :: held 1.556s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Created reservations ['3cd55756-bdf7-4173-9aba-4c7d10e9b32f', 'd5382f96-1d74-4169-8aee-413e7bef86ba', 'c98431ac-2312-46a1-a0ce-0f75ec9e2e97', '916d2225-dc71-45d2-a27b-a4736e66f430'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:53 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:53 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:53 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 1073741824" returned: 0 in 0.911s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:53 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 Jul 10 06:04:53 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:53 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.752s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Deleted volume successfully. Jul 10 06:04:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8e69e01e-e22d-48ff-a23c-569e531394e9 tempest-TestMinimumBasicScenario-943201652 None] Lock "cinder-25841284-004b-415b-915b-40cf4c3d463a-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:54 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302" returned: 0 in 0.725s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c25341e-3619-46ef-9fb9-9c0a169bd678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68681313-4532-492a-8850-159651949302', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7722af58-00b1-404b-aa32-9b7a6ce0304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:04:54 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Volume volume-68681313-4532-492a-8850-159651949302 (68681313-4532-492a-8850-159651949302): created successfully Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7722af58-00b1-404b-aa32-9b7a6ce0304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Flow 'volume_create_manager' (70906f37-0481-4ccf-af70-a5728fee3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:04:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1a0cab2e-000b-4cd7-b3f4-d1ad6685fcf8 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created volume successfully. Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-68681313-4532-492a-8850-159651949302-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-68681313-4532-492a-8850-159651949302-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-68681313-4532-492a-8850-159651949302" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-68681313-4532-492a-8850-159651949302" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:55 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d946d-0931-45e0-9e81-7c551a24d3e9]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:55 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 Jul 10 06:04:55 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:55 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302" returned: 0 in 0.895s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:55 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302 Jul 10 06:04:55 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:56 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-68681313-4532-492a-8850-159651949302" returned: 0 in 0.685s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-68681313-4532-492a-8850-159651949302" released by "delete_volume" :: held 1.639s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['85023be9-9d66-42a8-af77-6831fc86b959', '842856e4-a005-4d49-8087-ce1ecd0301e8', '482f5dda-a28c-4ca5-bbda-0e9645605ce2', 'ba33c608-d722-4b7a-9d6b-f3c44e9fb3bf'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:56 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:56 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-3e5e5d1c-944a-4aa1-99d9-79447d48e69e-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-3e5e5d1c-944a-4aa1-99d9-79447d48e69e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-3e5e5d1c-944a-4aa1-99d9-79447d48e69e" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-3e5e5d1c-944a-4aa1-99d9-79447d48e69e" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[24496e3d-60d4-4cbe-9cb8-9a724b5bcef6]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:57 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e Jul 10 06:04:57 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:57 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.675s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleted volume successfully. Jul 10 06:04:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-000a84b1-3d51-4dee-87dd-7baafcc29863 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-68681313-4532-492a-8850-159651949302-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:58 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e" returned: 0 in 0.804s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:58 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e Jul 10 06:04:58 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:58 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-3e5e5d1c-944a-4aa1-99d9-79447d48e69e" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-3e5e5d1c-944a-4aa1-99d9-79447d48e69e" released by "delete_volume" :: held 1.516s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['293ee89d-76c0-4b1c-b9a5-a7c8d1b3533f', '5a7460b9-a07e-4d71-817d-e6b33244b748', 'ffe2f965-e0e7-4e12-9a5c-8c1893a19b2e', '90275594-a09c-44f4-b9e9-08b8e60337ea'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:04:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:58 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:04:58 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-bc75e292-b48a-4858-809b-a865ff34548b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-bc75e292-b48a-4858-809b-a865ff34548b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-bc75e292-b48a-4858-809b-a865ff34548b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-bc75e292-b48a-4858-809b-a865ff34548b" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c65fb02-00a8-4536-b2b7-84e6bedd3b98]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:04:59 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.681s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:04:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleted volume successfully. Jul 10 06:04:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d0fb66d9-ee9c-4fe0-9514-de55cc9c5fa9 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-3e5e5d1c-944a-4aa1-99d9-79447d48e69e-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:04:59 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b Jul 10 06:04:59 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:00 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:00 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b Jul 10 06:05:00 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:00 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-bc75e292-b48a-4858-809b-a865ff34548b" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-bc75e292-b48a-4858-809b-a865ff34548b" released by "delete_volume" :: held 1.498s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['25030e50-74f0-4449-ab1b-a6ec9e8caeb9', '8e83412e-e299-4622-8c45-203c2a738005', 'c6f1065b-7a2a-4470-a4d9-cc1e806fd681', 'ba060c52-3242-4b53-a093-cbcf5513ed1d'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:01 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:01 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-d89e7d67-6142-454d-8b46-69fd77d033c5-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-d89e7d67-6142-454d-8b46-69fd77d033c5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-d89e7d67-6142-454d-8b46-69fd77d033c5" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-d89e7d67-6142-454d-8b46-69fd77d033c5" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:01 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ca89eb-77a1-4822-936a-0f94579b0b24]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.698s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleted volume successfully. Jul 10 06:05:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-717052c3-0e87-4dae-8f0b-f971e54391fd tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-bc75e292-b48a-4858-809b-a865ff34548b-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:01 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 Jul 10 06:05:01 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:02 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5" returned: 0 in 0.879s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:02 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5 Jul 10 06:05:02 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:03 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d89e7d67-6142-454d-8b46-69fd77d033c5" returned: 0 in 0.659s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-d89e7d67-6142-454d-8b46-69fd77d033c5" released by "delete_volume" :: held 1.588s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['c575fba4-9526-497a-a45d-96c951691e3a', '550e5259-fd35-48b8-b7f2-ae6db14f2163', '64becbb5-eae1-44e1-9b45-2ff9c1438196', '572175f1-2fec-4e0b-aa0e-88c9a7f68269'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:03 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:03 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f98de5-c7dd-4c92-abf2-cc3ba64c2da3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:04 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac Jul 10 06:05:04 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:04 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.759s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleted volume successfully. Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0a3f7994-d243-4278-a31b-31cd32c31589 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-d89e7d67-6142-454d-8b46-69fd77d033c5-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:04 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac" returned: 0 in 0.835s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:04 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac Jul 10 06:05:04 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:05 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac" returned: 0 in 0.685s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac" released by "delete_volume" :: held 1.569s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['87e74c78-7a1a-4b4e-a9ff-587e0ad516d8', '83379c78-20fa-468a-aa29-972307d1c4b5', '7b890f64-9fd1-4716-b5b0-df257e0f3ab7', 'dd135829-6eaa-4da6-a83e-a0789236deb7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:05 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:05 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-bf2aa3d6-2f16-4eba-a0fe-5ac754073e42-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-bf2aa3d6-2f16-4eba-a0fe-5ac754073e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-c7f7f393-5862-4b07-8a50-354c430f627e" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-c7f7f393-5862-4b07-8a50-354c430f627e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleting offline snapshot bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 of volume c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] snapshot_file for this snap is: volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e6bde5-2cca-497f-99c4-29b8db71effe]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:06 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.672s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleted volume successfully. Jul 10 06:05:06 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 Jul 10 06:05:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fdfcaf27-70a8-4bd3-9b6a-9866b800485f tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-9e810bbf-269a-4438-9c0e-6bca4ed3f4ac-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:06 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:07 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" returned: 0 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f7f393-5862-4b07-8a50-354c430f627e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:05:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09fd453-e0a0-41d8-ab9f-55f991852423]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:07 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e Jul 10 06:05:07 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:08 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e" returned: 0 in 0.830s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:08 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 Jul 10 06:05:08 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:08 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" returned: 0 in 0.799s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:08 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42 Jul 10 06:05:08 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:09 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e.bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" returned: 0 in 0.691s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-bf2aa3d6-2f16-4eba-a0fe-5ac754073e42" released by "_delete_snapshot" :: held 3.270s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-c7f7f393-5862-4b07-8a50-354c430f627e" released by "delete_snapshot" :: held 3.298s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:09 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['4b824fe1-fc74-457b-a862-b96663208e6a', '9d751d23-7a51-4fca-8e08-ab89a6e42d1c', '957c4392-5693-48ac-9d4a-9de797962c16', 'b32db573-da1d-4cb7-b5ed-0f2c5a47a21f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:09 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Delete snapshot completed successfully. Jul 10 06:05:09 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5e60e85b-6183-4b5c-b7eb-305d957dd042 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-bf2aa3d6-2f16-4eba-a0fe-5ac754073e42-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-c7f7f393-5862-4b07-8a50-354c430f627e-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-c7f7f393-5862-4b07-8a50-354c430f627e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "cinder-quobyte-c7f7f393-5862-4b07-8a50-354c430f627e" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-c7f7f393-5862-4b07-8a50-354c430f627e" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:10 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[234a3128-e28a-4835-8f80-8afd9c31d49c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:10 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e Jul 10 06:05:10 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:11 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e" returned: 0 in 0.859s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:11 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e Jul 10 06:05:11 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:11 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (b059077e-997d-484b-a5cf-ad34bf77b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6609d651-972f-4ae5-8580-46ad0d42ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6609d651-972f-4ae5-8580-46ad0d42ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-650044852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e44a63-679d-49f9-92eb-f81ebc61367e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:12Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4198ff8f-cf4f-4159-971c-07d59fa8b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4198ff8f-cf4f-4159-971c-07d59fa8b663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb1f90-fa6f-4ed9-b43f-95ea1adfdeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb1f90-fa6f-4ed9-b43f-95ea1adfdeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e44a63-679d-49f9-92eb-f81ebc61367e', 'volume_name': 'volume-19e44a63-679d-49f9-92eb-f81ebc61367e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5e65a2-b299-4d07-8530-8e60ca675a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5e65a2-b299-4d07-8530-8e60ca675a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d79478-c7a0-4178-973d-6a3f7fa238f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Volume 19e44a63-679d-49f9-92eb-f81ebc61367e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e44a63-679d-49f9-92eb-f81ebc61367e', 'volume_size': 1} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-650044852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e44a63-679d-49f9-92eb-f81ebc61367e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:12Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Creating volume 19e44a63-679d-49f9-92eb-f81ebc61367e {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:12 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:12 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e 1073741824 Jul 10 06:05:12 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:12 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c7f7f393-5862-4b07-8a50-354c430f627e" returned: 0 in 0.808s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-quobyte-c7f7f393-5862-4b07-8a50-354c430f627e" released by "delete_volume" :: held 1.749s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (117ea489-c351-4101-a2cb-c1ff60682006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab67e891-ef6a-4ec3-a858-87feef0874f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab67e891-ef6a-4ec3-a858-87feef0874f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161600025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7754c9fd-019f-400d-b6a9-a84a64887cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:12Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359e732a-45b8-4082-9c29-492511d4c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359e732a-45b8-4082-9c29-492511d4c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab6dae2-7983-47eb-ba7d-2316bc092cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab6dae2-7983-47eb-ba7d-2316bc092cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7754c9fd-019f-400d-b6a9-a84a64887cf1', 'volume_name': 'volume-7754c9fd-019f-400d-b6a9-a84a64887cf1', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4df2f3-677f-4880-bf1a-78ed77b6c2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4df2f3-677f-4880-bf1a-78ed77b6c2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b82b5d-d68a-4ca0-a138-071c204e3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Volume 7754c9fd-019f-400d-b6a9-a84a64887cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7754c9fd-019f-400d-b6a9-a84a64887cf1', 'volume_size': 1} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Created reservations ['5bbd77ec-6461-4ba5-ba4a-a272afca410b', 'be150e2b-bbd6-4f47-838d-699019d4f995', '41a81ea8-c139-4595-96b1-ed47ffcd1aa7', '3b67877c-1c2f-4215-872f-76b4a8fa4a0e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:12 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:12 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (d6da9812-908b-46b8-bbd4-06157cfba9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a94655b-7e4d-4e0c-85d2-47d6cb45bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a94655b-7e4d-4e0c-85d2-47d6cb45bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086407440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f8aae7-fbd1-4549-96db-e2cb846468fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:13Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef9a3c7-e71e-4de6-a9d0-accc8b5c4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef9a3c7-e71e-4de6-a9d0-accc8b5c4956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1253289-b5a7-4497-b4a6-a9896550f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1253289-b5a7-4497-b4a6-a9896550f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f8aae7-fbd1-4549-96db-e2cb846468fc', 'volume_name': 'volume-61f8aae7-fbd1-4549-96db-e2cb846468fc', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2d9bf0-5605-4985-ab02-f969660853c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2d9bf0-5605-4985-ab02-f969660853c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77751de1-ac5d-4b5e-a2fc-3fb568142a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Volume 61f8aae7-fbd1-4549-96db-e2cb846468fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f8aae7-fbd1-4549-96db-e2cb846468fc', 'volume_size': 1} Jul 10 06:05:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:13 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e 1073741824" returned: 0 in 1.134s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:13 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e Jul 10 06:05:13 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (6dfa0c8c-aa86-45ee-a341-81f1772c3f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430dcc43-538a-4818-87b8-7646c2b4e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430dcc43-538a-4818-87b8-7646c2b4e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868682441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f16c5-deef-4723-8ad1-453b0fa88dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:13Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfaaf5d6-dead-461d-9bb7-cf5e61219762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfaaf5d6-dead-461d-9bb7-cf5e61219762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef8fbc-af68-4e79-a31d-e27ee1acf87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef8fbc-af68-4e79-a31d-e27ee1acf87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694f16c5-deef-4723-8ad1-453b0fa88dba', 'volume_name': 'volume-694f16c5-deef-4723-8ad1-453b0fa88dba', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21fa5c1-f33b-47da-bc15-f5416507bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21fa5c1-f33b-47da-bc15-f5416507bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7736ba87-0b03-4343-b203-d5b31b791f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Volume 694f16c5-deef-4723-8ad1-453b0fa88dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694f16c5-deef-4723-8ad1-453b0fa88dba', 'volume_size': 1} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=78,cinder:UPDATE=96,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (008177a1-2431-4c12-880c-828196b0d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:13 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b524dce-860b-4bee-b0b0-8deeaf022851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.065s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b524dce-860b-4bee-b0b0-8deeaf022851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983936312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c95554c-0c7d-4ca1-ae7d-14e764662ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:14Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704bbbce-0d54-4e98-b8e7-5fbfdbb7459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704bbbce-0d54-4e98-b8e7-5fbfdbb7459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a88d4a-fee7-4dfa-8270-1ee2d9fc591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a88d4a-fee7-4dfa-8270-1ee2d9fc591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c95554c-0c7d-4ca1-ae7d-14e764662ffb', 'volume_name': 'volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5043a051-aebc-4649-8fbb-9499a4170f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5043a051-aebc-4649-8fbb-9499a4170f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f4562b-1e35-4679-893e-d60b556b6b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:13 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Volume 8c95554c-0c7d-4ca1-ae7d-14e764662ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb', 'volume_size': 1} Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:13 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Deleted volume successfully. Jul 10 06:05:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-af7124f6-559c-4a31-8b5d-6f65c66df265 tempest-CreateVolumesFromSnapshotTest-1316292048 None] Lock "cinder-c7f7f393-5862-4b07-8a50-354c430f627e-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:14 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e" returned: 0 in 0.888s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161600025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7754c9fd-019f-400d-b6a9-a84a64887cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:12Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Creating volume 7754c9fd-019f-400d-b6a9-a84a64887cf1 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:14 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:14 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 1073741824 Jul 10 06:05:14 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d79478-c7a0-4178-973d-6a3f7fa238f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e44a63-679d-49f9-92eb-f81ebc61367e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395cb696-bea6-44fa-b845-20caae3f9af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:14 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Volume volume-19e44a63-679d-49f9-92eb-f81ebc61367e (19e44a63-679d-49f9-92eb-f81ebc61367e): created successfully Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395cb696-bea6-44fa-b845-20caae3f9af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (b059077e-997d-484b-a5cf-ad34bf77b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1547f469-bc6c-49e0-91b2-22936cbd8ba2 tempest-CreateVolumesFromImageTest-1973589025 None] Created volume successfully. Jul 10 06:05:15 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 1073741824" returned: 0 in 0.884s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=102,cinder:SELECT=75,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:15 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 Jul 10 06:05:15 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:15 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2086407440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f8aae7-fbd1-4549-96db-e2cb846468fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:13Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Creating volume 61f8aae7-fbd1-4549-96db-e2cb846468fc {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:15 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:15 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc 1073741824 Jul 10 06:05:15 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b82b5d-d68a-4ca0-a138-071c204e3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7754c9fd-019f-400d-b6a9-a84a64887cf1', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9ed147-cfc4-4d58-bb24-df140ad82355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Volume volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 (7754c9fd-019f-400d-b6a9-a84a64887cf1): created successfully Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9ed147-cfc4-4d58-bb24-df140ad82355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (117ea489-c351-4101-a2cb-c1ff60682006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-db480007-1e6b-4a85-918c-a1180434e37b tempest-CreateVolumesFromImageTest-1973589025 None] Created volume successfully. Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Flow 'volume_create_manager' (d344762b-36af-4dca-82ea-61c6a6952b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22f57e8-d460-4816-ac02-cdcb4ab10caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22f57e8-d460-4816-ac02-cdcb4ab10caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c4afee-3700-4868-9700-55d516ea2073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5fabdb54c54b68a6ec31cce512f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:16Z,use_quota=True,user_id='55cf9a21c85243c683a42300cb8701a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aac535-11ec-4a99-87e6-7e6827093fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aac535-11ec-4a99-87e6-7e6827093fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8260d23d-e075-421e-a598-ec2d9f466828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8260d23d-e075-421e-a598-ec2d9f466828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c4afee-3700-4868-9700-55d516ea2073', 'volume_name': 'volume-73c4afee-3700-4868-9700-55d516ea2073', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458fdaa1-80f3-4b0c-a077-87b437f49f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458fdaa1-80f3-4b0c-a077-87b437f49f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511b7ec0-8c5d-4aa2-b4aa-c6ef136fa9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:16 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Volume 73c4afee-3700-4868-9700-55d516ea2073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c4afee-3700-4868-9700-55d516ea2073', 'volume_size': 1} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:16 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc 1073741824" returned: 0 in 0.871s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:16 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc Jul 10 06:05:16 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:17 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc" returned: 0 in 0.634s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.906s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868682441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f16c5-deef-4723-8ad1-453b0fa88dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:13Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Creating volume 694f16c5-deef-4723-8ad1-453b0fa88dba {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:17 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77751de1-ac5d-4b5e-a2fc-3fb568142a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f8aae7-fbd1-4549-96db-e2cb846468fc', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:17 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba 1073741824 Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788c1158-af2f-4beb-a433-368ba87f21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:17 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:17 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Volume volume-61f8aae7-fbd1-4549-96db-e2cb846468fc (61f8aae7-fbd1-4549-96db-e2cb846468fc): created successfully Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788c1158-af2f-4beb-a433-368ba87f21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:17 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (d6da9812-908b-46b8-bbd4-06157cfba9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-984cd2d8-05fb-4116-bdb7-4aa7addebf76 tempest-CreateVolumesFromImageTest-1973589025 None] Created volume successfully. Jul 10 06:05:18 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba 1073741824" returned: 0 in 0.888s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:18 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba Jul 10 06:05:18 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:18 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba" returned: 0 in 0.677s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.090s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983936312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c95554c-0c7d-4ca1-ae7d-14e764662ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2d2551dfad4f4f806719ac1583f087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:14Z,use_quota=True,user_id='952f4a82d22a465387650163e00299f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Creating volume 8c95554c-0c7d-4ca1-ae7d-14e764662ffb {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:18 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:18 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb 1073741824 Jul 10 06:05:18 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7736ba87-0b03-4343-b203-d5b31b791f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694f16c5-deef-4723-8ad1-453b0fa88dba', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74186b01-c149-4d0d-bc6d-19070834e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Volume volume-694f16c5-deef-4723-8ad1-453b0fa88dba (694f16c5-deef-4723-8ad1-453b0fa88dba): created successfully Jul 10 06:05:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74186b01-c149-4d0d-bc6d-19070834e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (6dfa0c8c-aa86-45ee-a341-81f1772c3f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-68c063d9-d8ac-430d-9920-d8f4cca03eb6 tempest-CreateVolumesFromImageTest-1973589025 None] Created volume successfully. Jul 10 06:05:19 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb 1073741824" returned: 0 in 0.894s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:19 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb Jul 10 06:05:19 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:20 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb" returned: 0 in 0.669s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c4afee-3700-4868-9700-55d516ea2073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5fabdb54c54b68a6ec31cce512f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:16Z,use_quota=True,user_id='55cf9a21c85243c683a42300cb8701a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Creating volume 73c4afee-3700-4868-9700-55d516ea2073 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:20 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f4562b-1e35-4679-893e-d60b556b6b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:20 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 1073741824 Jul 10 06:05:20 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97564fd-c88f-443c-9b1b-e8d628a1bc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Volume volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb (8c95554c-0c7d-4ca1-ae7d-14e764662ffb): created successfully Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97564fd-c88f-443c-9b1b-e8d628a1bc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Flow 'volume_create_manager' (008177a1-2431-4c12-880c-828196b0d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:20 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e0e31840-e7d7-40b0-ad79-79eb1afbaa7d tempest-CreateVolumesFromImageTest-1973589025 None] Created volume successfully. Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-8c95554c-0c7d-4ca1-ae7d-14e764662ffb-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-8c95554c-0c7d-4ca1-ae7d-14e764662ffb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-quobyte-8c95554c-0c7d-4ca1-ae7d-14e764662ffb" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-8c95554c-0c7d-4ca1-ae7d-14e764662ffb" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:21 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 1073741824" returned: 0 in 0.908s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e71c8-4c1e-41d3-bbd3-214d6f8ef145]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:21 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 Jul 10 06:05:21 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:21 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb Jul 10 06:05:21 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:22 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073" returned: 0 in 0.671s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511b7ec0-8c5d-4aa2-b4aa-c6ef136fa9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c4afee-3700-4868-9700-55d516ea2073', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99aa116a-e7e8-47d5-a8cd-1a92ba578ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:22 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Volume volume-73c4afee-3700-4868-9700-55d516ea2073 (73c4afee-3700-4868-9700-55d516ea2073): created successfully Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99aa116a-e7e8-47d5-a8cd-1a92ba578ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Flow 'volume_create_manager' (d344762b-36af-4dca-82ea-61c6a6952b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c543520f-a7ff-44ae-9faa-f3606e8c4fa5 tempest-CinderUnicodeTest-254048370 None] Created volume successfully. Jul 10 06:05:22 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb" returned: 0 in 0.787s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:22 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb Jul 10 06:05:22 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:22 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8c95554c-0c7d-4ca1-ae7d-14e764662ffb" returned: 0 in 0.701s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-8c95554c-0c7d-4ca1-ae7d-14e764662ffb" released by "delete_volume" :: held 1.546s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Created reservations ['ef52f430-28d0-467a-85d1-14811ce21ef0', 'aa09982c-5fe6-41c1-983b-c69dd39c8eee', '80434459-b182-4adf-9e8f-471e4aa0cf28', '87a855d4-43d0-402a-9791-4c5eee09a6ed'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:23 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:23 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Flow 'volume_create_manager' (2cd37dc9-f1b6-43c0-9f47-dc8f4dd210b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19573402-4b97-4d94-8803-97d965ebd086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19573402-4b97-4d94-8803-97d965ebd086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1754797156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7305646-2d3e-41e8-8f98-f2a517cf730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5fabdb54c54b68a6ec31cce512f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:23Z,use_quota=True,user_id='55cf9a21c85243c683a42300cb8701a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70afa617-53ae-4aea-ba06-fd2f013279d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70afa617-53ae-4aea-ba06-fd2f013279d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f995b2b1-0bfd-47ff-8459-9f8097360899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f995b2b1-0bfd-47ff-8459-9f8097360899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7305646-2d3e-41e8-8f98-f2a517cf730d', 'volume_name': 'volume-a7305646-2d3e-41e8-8f98-f2a517cf730d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca53bea-e992-40d0-a5d4-f68e6cc72ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca53bea-e992-40d0-a5d4-f68e6cc72ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03668d3-38c1-4cba-8e38-b93a1dfda12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:23 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Volume a7305646-2d3e-41e8-8f98-f2a517cf730d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7305646-2d3e-41e8-8f98-f2a517cf730d', 'volume_size': 1} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1754797156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7305646-2d3e-41e8-8f98-f2a517cf730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5fabdb54c54b68a6ec31cce512f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:23Z,use_quota=True,user_id='55cf9a21c85243c683a42300cb8701a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Creating volume a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:23 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:23 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d 1073741824 Jul 10 06:05:23 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-694f16c5-deef-4723-8ad1-453b0fa88dba-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-694f16c5-deef-4723-8ad1-453b0fa88dba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-quobyte-694f16c5-deef-4723-8ad1-453b0fa88dba" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-694f16c5-deef-4723-8ad1-453b0fa88dba" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc24f95-c43a-45c3-bf02-03b2c8f0b2db]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:23 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.693s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Deleted volume successfully. Jul 10 06:05:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b772a9bf-c008-437d-a7a2-16872c2fefb5 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-8c95554c-0c7d-4ca1-ae7d-14e764662ffb-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:23 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba Jul 10 06:05:23 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:24 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d 1073741824" returned: 0 in 0.904s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:24 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d Jul 10 06:05:24 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:24 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba" returned: 0 in 0.857s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:24 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba Jul 10 06:05:24 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:24 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d" returned: 0 in 0.672s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03668d3-38c1-4cba-8e38-b93a1dfda12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7305646-2d3e-41e8-8f98-f2a517cf730d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3c0b95-5937-43b8-9123-b68257c564c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Volume volume-a7305646-2d3e-41e8-8f98-f2a517cf730d (a7305646-2d3e-41e8-8f98-f2a517cf730d): created successfully Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3c0b95-5937-43b8-9123-b68257c564c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Flow 'volume_create_manager' (2cd37dc9-f1b6-43c0-9f47-dc8f4dd210b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d9c1366e-6a93-41b0-b5a5-6daaa501cf6f tempest-CinderUnicodeTest-254048370 None] Created volume successfully. Jul 10 06:05:25 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-694f16c5-deef-4723-8ad1-453b0fa88dba" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-694f16c5-deef-4723-8ad1-453b0fa88dba" released by "delete_volume" :: held 1.571s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Created reservations ['2415248e-bf28-4bd8-8a77-f7163035f826', '1faf52f8-d9d9-48dc-ab3c-2a3466e2c16c', 'ee5a1a4e-1f8e-4cb0-b6fe-4007f3aa4206', 'c92529b9-47b4-49c6-901b-4c5bbd3985e2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:25 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:25 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Creating offline snapshot 57bf2d36-94ef-4ec8-8849-31a1e7f17f1f of volume a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90488c4-0d23-4a7b-978a-2c33f791ccb3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:25 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d Jul 10 06:05:25 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-61f8aae7-fbd1-4549-96db-e2cb846468fc-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-61f8aae7-fbd1-4549-96db-e2cb846468fc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-quobyte-61f8aae7-fbd1-4549-96db-e2cb846468fc" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-61f8aae7-fbd1-4549-96db-e2cb846468fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e44d6-93d4-4864-8599-3ff0c11a04ef]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:26 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc Jul 10 06:05:26 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:26 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.719s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Deleted volume successfully. Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-47e2d380-fbfc-436a-be1c-4622d41310ab tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-694f16c5-deef-4723-8ad1-453b0fa88dba-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:26 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d" returned: 0 in 0.799s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:26 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f 1G Jul 10 06:05:26 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:26 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc" returned: 0 in 0.797s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:26 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc Jul 10 06:05:26 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:27 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f 1G" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7305646-2d3e-41e8-8f98-f2a517cf730d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:27 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7305646-2d3e-41e8-8f98-f2a517cf730d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f Jul 10 06:05:27 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:27 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-61f8aae7-fbd1-4549-96db-e2cb846468fc" returned: 0 in 0.657s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-61f8aae7-fbd1-4549-96db-e2cb846468fc" released by "delete_volume" :: held 1.514s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Created reservations ['adec8bea-6794-4950-957e-0d156cf78c7e', '6fd9a466-db79-4572-8b0d-d1cc55e0f33e', '9c71bfdb-d560-4a41-87d9-dcc882fca7fa', '8c38295d-098b-41e0-b3bf-013ba0d3d9e6'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:27 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:27 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:27 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7305646-2d3e-41e8-8f98-f2a517cf730d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" returned: 0 in 0.681s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:27 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f is being set with open permissions: ugo+rw Jul 10 06:05:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:27 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f Jul 10 06:05:27 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-7754c9fd-019f-400d-b6a9-a84a64887cf1-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-7754c9fd-019f-400d-b6a9-a84a64887cf1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-quobyte-7754c9fd-019f-400d-b6a9-a84a64887cf1" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-7754c9fd-019f-400d-b6a9-a84a64887cf1" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c86d71-1a72-4617-975e-5746d9b1f98b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:28 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.656s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Deleted volume successfully. Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-16f43d8a-fc50-4f66-9bdf-3ce3f88d3b3f tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-61f8aae7-fbd1-4549-96db-e2cb846468fc-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:28 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 Jul 10 06:05:28 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:28 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" returned: 0 in 0.692s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:28 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info Jul 10 06:05:28 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:28 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:28 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:29 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1" returned: 0 in 0.802s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:29 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1 Jul 10 06:05:29 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:29 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info" returned: 0 in 0.684s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:29 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info is being set with open permissions: ugo+rw Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:29 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info Jul 10 06:05:29 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:29 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:05:29 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7754c9fd-019f-400d-b6a9-a84a64887cf1" returned: 0 in 0.689s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-7754c9fd-019f-400d-b6a9-a84a64887cf1" released by "delete_volume" :: held 1.536s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Created reservations ['04bc006e-c35d-410c-a0a5-b074d94674d7', '1252f5a0-811c-4335-abb1-6b498b15db31', '26b27e45-7902-4fc2-ab06-d4f4920ae11a', '219c0961-9748-4580-8bdb-8fb6e6b07d87'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:29 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:29 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:29 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.info" returned: 0 in 0.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.475s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-890b4d8a-5ff9-434f-8b3a-00c2f1b5d504 tempest-CinderUnicodeTest-254048370 None] Create snapshot completed successfully Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-19e44a63-679d-49f9-92eb-f81ebc61367e-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-19e44a63-679d-49f9-92eb-f81ebc61367e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "cinder-quobyte-19e44a63-679d-49f9-92eb-f81ebc61367e" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-19e44a63-679d-49f9-92eb-f81ebc61367e" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6169f0-9277-4414-8633-9aab82f7e1b3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:30 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.687s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Deleted volume successfully. Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5b164b30-6885-41cb-83ee-8df87838decf tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-7754c9fd-019f-400d-b6a9-a84a64887cf1-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:30 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e Jul 10 06:05:30 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-57bf2d36-94ef-4ec8-8849-31a1e7f17f1f-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Lock "cinder-57bf2d36-94ef-4ec8-8849-31a1e7f17f1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-quobyte-a7305646-2d3e-41e8-8f98-f2a517cf730d" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-a7305646-2d3e-41e8-8f98-f2a517cf730d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-quobyte-57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Deleting offline snapshot 57bf2d36-94ef-4ec8-8849-31a1e7f17f1f of volume a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] snapshot_file for this snap is: volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b3d1aa-ec5c-4c18-a3a7-ca9e4b70aa40]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:30 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f Jul 10 06:05:30 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:31 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e" returned: 0 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:31 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e Jul 10 06:05:31 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:31 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" returned: 0 in 0.799s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7305646-2d3e-41e8-8f98-f2a517cf730d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58736c36-d306-46d0-abd2-cf849c3e5e4a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:31 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d Jul 10 06:05:31 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:31 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-19e44a63-679d-49f9-92eb-f81ebc61367e" returned: 0 in 0.676s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-quobyte-19e44a63-679d-49f9-92eb-f81ebc61367e" released by "delete_volume" :: held 1.552s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Created reservations ['3525e9d2-e14c-446a-b06f-6da91c9fc1b9', '06786afe-4bf4-4528-9e28-a1111dc901e8', '85fd3e15-5262-4166-a276-f64562d4c5c1', 'c685d38d-8acd-428a-b97b-9b6c5946317f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:32 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:32 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:32 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d" returned: 0 in 0.792s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:32 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f Jul 10 06:05:32 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:32 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Deleted volume successfully. Jul 10 06:05:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-85e5f796-213b-4d10-92b9-138edaa1ed17 tempest-CreateVolumesFromImageTest-1973589025 None] Lock "cinder-19e44a63-679d-49f9-92eb-f81ebc61367e-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:33 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:33 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f Jul 10 06:05:33 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:33 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d.57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" returned: 0 in 0.722s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-57bf2d36-94ef-4ec8-8849-31a1e7f17f1f" released by "_delete_snapshot" :: held 3.171s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-a7305646-2d3e-41e8-8f98-f2a517cf730d" released by "delete_snapshot" :: held 3.194s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:34 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Created reservations ['1727abb0-3e66-4c81-9e74-fea0bdf7cfb2', '4ac43d6a-ce54-44b7-a0b3-9f4d73380cd0', '0b69e48b-0f27-4100-81a2-45bf9229336b', '23dd2fd7-e2b8-45e4-87b8-b493547bd640'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Delete snapshot completed successfully. Jul 10 06:05:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-06b92f05-c1f3-483c-9452-417da708155a tempest-CinderUnicodeTest-254048370 None] Lock "cinder-57bf2d36-94ef-4ec8-8849-31a1e7f17f1f-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-a7305646-2d3e-41e8-8f98-f2a517cf730d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Lock "cinder-a7305646-2d3e-41e8-8f98-f2a517cf730d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-quobyte-a7305646-2d3e-41e8-8f98-f2a517cf730d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-a7305646-2d3e-41e8-8f98-f2a517cf730d" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07054a4-687c-441d-bf01-a236184f7634]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:35 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d Jul 10 06:05:35 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (18005d3d-648e-42fd-a0b9-a30795287cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44225f29-52ac-4d71-97d1-222c5fb93ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44225f29-52ac-4d71-97d1-222c5fb93ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975307200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceef0947-6e42-4d5f-899f-e17bdf98e3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:35Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c601b9c5-9c30-44ff-a529-e272be66a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c601b9c5-9c30-44ff-a529-e272be66a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad12cfc-1753-4073-be2c-8210685211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad12cfc-1753-4073-be2c-8210685211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceef0947-6e42-4d5f-899f-e17bdf98e3ba', 'volume_name': 'volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872fd85c-6892-40d7-8a59-673efab442c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872fd85c-6892-40d7-8a59-673efab442c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328114b0-b151-48fa-a3d8-b9b8fc2c7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume ceef0947-6e42-4d5f-899f-e17bdf98e3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba', 'volume_size': 1} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975307200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceef0947-6e42-4d5f-899f-e17bdf98e3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:35Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Creating volume ceef0947-6e42-4d5f-899f-e17bdf98e3ba {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:35 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:35 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba 1073741824 Jul 10 06:05:35 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:35 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d" returned: 0 in 0.809s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:35 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d Jul 10 06:05:35 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:36 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba 1073741824" returned: 0 in 0.814s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:36 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba Jul 10 06:05:36 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:36 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a7305646-2d3e-41e8-8f98-f2a517cf730d" returned: 0 in 0.670s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-a7305646-2d3e-41e8-8f98-f2a517cf730d" released by "delete_volume" :: held 1.543s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Created reservations ['5623a9a2-dff5-4599-a1fd-cfe1a890fc44', 'f31db0dd-0540-4bdc-81d8-0c41634b40c9', 'a36f2c21-a7d6-46d9-946d-1cf27776885b', '7adcc2f6-eceb-4178-86ee-1d8bbef020f8'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:36 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:36 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:37 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328114b0-b151-48fa-a3d8-b9b8fc2c7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e5ac2a-f5ac-4f0a-a7ee-06cbc10b6060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba (ceef0947-6e42-4d5f-899f-e17bdf98e3ba): created successfully Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e5ac2a-f5ac-4f0a-a7ee-06cbc10b6060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (18005d3d-648e-42fd-a0b9-a30795287cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6412a15a-0166-40db-b8c2-fa63f5e94e24 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created volume successfully. Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-73c4afee-3700-4868-9700-55d516ea2073-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Lock "cinder-73c4afee-3700-4868-9700-55d516ea2073-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Acquiring lock "cinder-quobyte-73c4afee-3700-4868-9700-55d516ea2073" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-73c4afee-3700-4868-9700-55d516ea2073" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38cf2e7-2367-40d6-b7af-7e3675f25a28]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:37 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.676s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Deleted volume successfully. Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-bf41c475-e925-4652-8246-7d6bcca6f46d tempest-CinderUnicodeTest-254048370 None] Lock "cinder-a7305646-2d3e-41e8-8f98-f2a517cf730d-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:37 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 Jul 10 06:05:37 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (6ff3ffd2-2177-4da9-8ab6-49939fbcbbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f600a0b8-e83b-463d-9fb9-15abca18233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f600a0b8-e83b-463d-9fb9-15abca18233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093115242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6f07e1-4999-44b9-80a4-c0df9b952678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:38Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f732ae52-6124-4b05-936e-999a28698d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f732ae52-6124-4b05-936e-999a28698d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee2a62c-e8bd-404d-8e05-886577a33956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee2a62c-e8bd-404d-8e05-886577a33956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6f07e1-4999-44b9-80a4-c0df9b952678', 'volume_name': 'volume-6b6f07e1-4999-44b9-80a4-c0df9b952678', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b8c3b4-e006-433a-ad95-af86b2d2a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b8c3b4-e006-433a-ad95-af86b2d2a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0574a8e6-0d1a-40c1-ab5a-013edf1d9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume 6b6f07e1-4999-44b9-80a4-c0df9b952678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6f07e1-4999-44b9-80a4-c0df9b952678', 'volume_size': 1} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093115242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6f07e1-4999-44b9-80a4-c0df9b952678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:38Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Creating volume 6b6f07e1-4999-44b9-80a4-c0df9b952678 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:38 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:38 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 1073741824 Jul 10 06:05:38 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:38 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073" returned: 0 in 0.802s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:38 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073 Jul 10 06:05:38 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (4786138f-74b1-4fec-98b7-6dd88cc6ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e68be4-1db2-43f4-ba55-3d68ecef3299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e68be4-1db2-43f4-ba55-3d68ecef3299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587573611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b48b11d-f63c-46ae-8e60-8089de74703b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:38Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec5a40d-56ae-4cd1-a356-dd0cdca7fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec5a40d-56ae-4cd1-a356-dd0cdca7fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d48a507-9266-4b24-84f7-c1c01408f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d48a507-9266-4b24-84f7-c1c01408f502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b48b11d-f63c-46ae-8e60-8089de74703b', 'volume_name': 'volume-8b48b11d-f63c-46ae-8e60-8089de74703b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebffaf3-b100-4c74-91cf-678c23199aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebffaf3-b100-4c74-91cf-678c23199aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e04ec6-1c92-4ba7-9af9-4fb2af9b8e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume 8b48b11d-f63c-46ae-8e60-8089de74703b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b48b11d-f63c-46ae-8e60-8089de74703b', 'volume_size': 1} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (224137ec-4cdb-4f9a-b35d-e8fe6f24a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5deed878-ef5d-4759-bae1-924807e584b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5deed878-ef5d-4759-bae1-924807e584b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586545100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:39Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe12534b-0f5e-468e-90ea-bb43183e1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe12534b-0f5e-468e-90ea-bb43183e1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059ceed4-774f-4393-b5e3-32c6721899b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059ceed4-774f-4393-b5e3-32c6721899b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7', 'volume_name': 'volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524ea691-e7b9-4218-8bdf-88070a3c0bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524ea691-e7b9-4218-8bdf-88070a3c0bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674c73ad-1220-4504-80a2-3b561237c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7', 'volume_size': 1} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:38 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-73c4afee-3700-4868-9700-55d516ea2073" returned: 0 in 0.810s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Lock "cinder-quobyte-73c4afee-3700-4868-9700-55d516ea2073" released by "delete_volume" :: held 1.662s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Created reservations ['5d77c12a-d6ce-42a9-a17c-074d4c215ee7', '9345fa75-30b9-4e42-a1ab-97179edc3702', '296a6ccb-6501-42d0-9fc8-e5d3450b0c30', '6b749219-ba87-41ed-afcf-3688f12bb458'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (760f5020-6244-4b85-90b5-da9a3d1dfef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0e3288-bdb1-4db7-b81e-e8f3b0f02165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0e3288-bdb1-4db7-b81e-e8f3b0f02165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99608834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae61c6cd-2f76-4604-9a88-4f20bc4af7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:39Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe26ead-f01e-438d-8d42-31c804fe7c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe26ead-f01e-438d-8d42-31c804fe7c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2dd0f-ac0e-4642-b5f9-faaa1947a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2dd0f-ac0e-4642-b5f9-faaa1947a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae61c6cd-2f76-4604-9a88-4f20bc4af7b7', 'volume_name': 'volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b21566c-57fc-4fe4-9567-9d7c9e98110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b21566c-57fc-4fe4-9567-9d7c9e98110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36585e8-cd62-4dae-a491-4641a2a7555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume ae61c6cd-2f76-4604-9a88-4f20bc4af7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7', 'volume_size': 1} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:39 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 1073741824" returned: 0 in 1.165s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:39 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:39 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:39 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 Jul 10 06:05:39 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (ec0fe696-b6a5-4868-991d-f53e64a19f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11054c95-7956-465c-8b0d-4688ef06ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11054c95-7956-465c-8b0d-4688ef06ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-964886217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850207fc-d559-4330-ad9e-36f574af1c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:39Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f734d2-1c55-4f21-9f0d-70288d2896c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f734d2-1c55-4f21-9f0d-70288d2896c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308af167-653e-4546-821e-40c30ebd4842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308af167-653e-4546-821e-40c30ebd4842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850207fc-d559-4330-ad9e-36f574af1c66', 'volume_name': 'volume-850207fc-d559-4330-ad9e-36f574af1c66', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a03c46-dc49-4e27-a96b-0f0c2b2e95ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a03c46-dc49-4e27-a96b-0f0c2b2e95ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd43480-e2fb-4cc8-923f-870537867130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume 850207fc-d559-4330-ad9e-36f574af1c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850207fc-d559-4330-ad9e-36f574af1c66', 'volume_size': 1} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:39 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:39 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Deleted volume successfully. Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-386a0b06-7227-45a6-8a1f-6754c980eff0 tempest-CinderUnicodeTest-254048370 None] Lock "cinder-73c4afee-3700-4868-9700-55d516ea2073-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:40 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678" returned: 0 in 0.793s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587573611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b48b11d-f63c-46ae-8e60-8089de74703b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:38Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Creating volume 8b48b11d-f63c-46ae-8e60-8089de74703b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:40 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0574a8e6-0d1a-40c1-ab5a-013edf1d9d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6f07e1-4999-44b9-80a4-c0df9b952678', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:40 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b 1073741824 Jul 10 06:05:40 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7013c7-a414-4bd8-9490-6b4a17f6ae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 (6b6f07e1-4999-44b9-80a4-c0df9b952678): created successfully Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7013c7-a414-4bd8-9490-6b4a17f6ae8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (6ff3ffd2-2177-4da9-8ab6-49939fbcbbc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-babe6892-7ab7-45f6-98da-962f90e7335b tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created volume successfully. Jul 10 06:05:41 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b 1073741824" returned: 0 in 0.934s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:41 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b Jul 10 06:05:41 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:41 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.839s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586545100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:39Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Creating volume b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:41 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:41 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 1073741824 Jul 10 06:05:41 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e04ec6-1c92-4ba7-9af9-4fb2af9b8e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b48b11d-f63c-46ae-8e60-8089de74703b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd6f86d-07aa-468b-8bc6-8f310f8c097d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume volume-8b48b11d-f63c-46ae-8e60-8089de74703b (8b48b11d-f63c-46ae-8e60-8089de74703b): created successfully Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd6f86d-07aa-468b-8bc6-8f310f8c097d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (4786138f-74b1-4fec-98b7-6dd88cc6ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3fa2d0c9-5040-44f4-8b24-5e2bd893ad02 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created volume successfully. Jul 10 06:05:42 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 1073741824" returned: 0 in 0.846s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:42 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 Jul 10 06:05:42 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Flow 'volume_create_manager' (a255e3f9-a393-4965-b1de-7d02ac35133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4712eba-ea83-46f7-8e0a-9ece8f73f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4712eba-ea83-46f7-8e0a-9ece8f73f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679352191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748cf86f-3198-46a3-b6a8-6a15acdf0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35977ad2dcb94ef990faef940d7c53ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:43Z,use_quota=True,user_id='eb7e769002224638b07f98f53f75d527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d7ae6c-2b51-4b0e-b4a0-f08b2426a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d7ae6c-2b51-4b0e-b4a0-f08b2426a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eba2b4-28dc-4f8c-af1f-cdc99321e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eba2b4-28dc-4f8c-af1f-cdc99321e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748cf86f-3198-46a3-b6a8-6a15acdf0a8c', 'volume_name': 'volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c7f306-4136-48cc-9b07-4779ca7cef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c7f306-4136-48cc-9b07-4779ca7cef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a098e7a-e5e6-4bf1-99f5-5501aa22cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:43 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Volume 748cf86f-3198-46a3-b6a8-6a15acdf0a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c', 'volume_size': 1} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:43 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7" returned: 0 in 0.694s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.159s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99608834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae61c6cd-2f76-4604-9a88-4f20bc4af7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:39Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Creating volume ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:43 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674c73ad-1220-4504-80a2-3b561237c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11627239-d5a4-4f72-8bce-3140833c3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:43 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 1073741824 Jul 10 06:05:43 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:43 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 (b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7): created successfully Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11627239-d5a4-4f72-8bce-3140833c3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (224137ec-4cdb-4f9a-b35d-e8fe6f24a214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a755cd42-09e2-4d05-a07a-d008ee744592 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created volume successfully. Jul 10 06:05:44 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 1073741824" returned: 0 in 0.823s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:44 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 Jul 10 06:05:44 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:44 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7" returned: 0 in 0.643s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.195s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-964886217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850207fc-d559-4330-ad9e-36f574af1c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7009f9d067474e28b1276015e2be2699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:39Z,use_quota=True,user_id='e3b81fb6e14a43fd8f1a28db3543fef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Creating volume 850207fc-d559-4330-ad9e-36f574af1c66 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:44 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:44 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 1073741824 Jul 10 06:05:44 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36585e8-cd62-4dae-a491-4641a2a7555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5e9fe6-5b32-49be-ae48-9b31bdd43d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 (ae61c6cd-2f76-4604-9a88-4f20bc4af7b7): created successfully Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5e9fe6-5b32-49be-ae48-9b31bdd43d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (760f5020-6244-4b85-90b5-da9a3d1dfef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7516dbad-fc6c-40ef-9233-898582c8aaea tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created volume successfully. Jul 10 06:05:45 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 1073741824" returned: 0 in 0.860s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:45 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 Jul 10 06:05:45 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:46 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66" returned: 0 in 0.635s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679352191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748cf86f-3198-46a3-b6a8-6a15acdf0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35977ad2dcb94ef990faef940d7c53ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:43Z,use_quota=True,user_id='eb7e769002224638b07f98f53f75d527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Creating volume 748cf86f-3198-46a3-b6a8-6a15acdf0a8c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:46 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd43480-e2fb-4cc8-923f-870537867130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850207fc-d559-4330-ad9e-36f574af1c66', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4895c78-4314-4153-8ac9-ca5e188b986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:46 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c 1073741824 Jul 10 06:05:46 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Volume volume-850207fc-d559-4330-ad9e-36f574af1c66 (850207fc-d559-4330-ad9e-36f574af1c66): created successfully Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4895c78-4314-4153-8ac9-ca5e188b986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Flow 'volume_create_manager' (ec0fe696-b6a5-4868-991d-f53e64a19f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d8147306-d21e-4150-bec2-f441a18c6d05 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created volume successfully. Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-850207fc-d559-4330-ad9e-36f574af1c66-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-850207fc-d559-4330-ad9e-36f574af1c66-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-quobyte-850207fc-d559-4330-ad9e-36f574af1c66" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:47 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-850207fc-d559-4330-ad9e-36f574af1c66" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c 1073741824" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a2c5b-40a4-48e0-a5f1-e8d58e03ab77]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:47 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c Jul 10 06:05:47 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:47 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 Jul 10 06:05:47 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:47 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c" returned: 0 in 0.637s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a098e7a-e5e6-4bf1-99f5-5501aa22cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d947be-2a7e-426e-abf5-d7fb55730ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:47 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Volume volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c (748cf86f-3198-46a3-b6a8-6a15acdf0a8c): created successfully Jul 10 06:05:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d947be-2a7e-426e-abf5-d7fb55730ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Flow 'volume_create_manager' (a255e3f9-a393-4965-b1de-7d02ac35133d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c15d2843-f4e6-428c-8e94-107b94fc18c9 tempest-ProjectReaderTests-2018550835 None] Created volume successfully. Jul 10 06:05:48 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66" returned: 0 in 0.791s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:48 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66 Jul 10 06:05:48 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Acquiring lock "cinder-748cf86f-3198-46a3-b6a8-6a15acdf0a8c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Lock "cinder-748cf86f-3198-46a3-b6a8-6a15acdf0a8c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Acquiring lock "cinder-quobyte-748cf86f-3198-46a3-b6a8-6a15acdf0a8c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Lock "cinder-quobyte-748cf86f-3198-46a3-b6a8-6a15acdf0a8c" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[089a1308-dcab-4255-a6c1-bc0852ab9a9e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:48 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-850207fc-d559-4330-ad9e-36f574af1c66" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-850207fc-d559-4330-ad9e-36f574af1c66" released by "delete_volume" :: held 1.508s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created reservations ['744faa19-a30e-49e2-90d9-8a88a68d3252', '27d42742-92d6-493e-b75c-868214b0f0dc', '800d9c17-d329-4d54-92fe-c7ef9419c6c4', '3f8802c6-04fa-452a-a05c-c26b4a3f4257'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:48 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c Jul 10 06:05:48 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:48 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:48 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-quobyte-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:49 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c" returned: 0 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7" acquired by "delete_volume" :: waited 0.044s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:49 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c Jul 10 06:05:49 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:49 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.673s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Deleted volume successfully. Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fab017-89e2-4e14-a2d3-68b17db823c5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4487f42d-3d39-4f17-8cfe-35608a726fc2 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-850207fc-d559-4330-ad9e-36f574af1c66-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:49 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 Jul 10 06:05:49 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:50 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-748cf86f-3198-46a3-b6a8-6a15acdf0a8c" returned: 0 in 0.710s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Lock "cinder-quobyte-748cf86f-3198-46a3-b6a8-6a15acdf0a8c" released by "delete_volume" :: held 1.558s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Created reservations ['a61509c2-e8fe-48d1-845f-8a33fe33cef5', 'fc839f86-0a37-456e-8aed-051324bf7972', 'e4689aa8-6ac7-4e46-9a47-e66787991c8a', 'a0f3b338-06d0-4d86-a3bf-c1fa70f16d63'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:50 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7" returned: 0 in 0.784s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:50 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7 Jul 10 06:05:50 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:50 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:50 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:51 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.659s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Deleted volume successfully. Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0dbeaed6-1121-49b8-b81c-af031082d56a tempest-ProjectReaderTests-2018550835 None] Lock "cinder-748cf86f-3198-46a3-b6a8-6a15acdf0a8c-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:51 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7" returned: 0 in 0.732s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7" released by "delete_volume" :: held 1.577s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created reservations ['08d5fa03-17e4-4ed7-b228-6df8f170b696', 'a8001842-5ad2-4314-9957-9df5fe53a89c', 'af1fb214-9af7-4068-9453-2e63553c5875', '52e64722-408b-4fd4-82a0-dcd4766228df'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:51 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:51 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Flow 'volume_create_manager' (1cfd8354-fb4a-43a5-8a8f-831373a31a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7cbd6d-9d1f-4e24-87b7-7918802b56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7cbd6d-9d1f-4e24-87b7-7918802b56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461645211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a20ef5-d50e-4528-be56-42554712a154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35977ad2dcb94ef990faef940d7c53ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:51Z,use_quota=True,user_id='eb7e769002224638b07f98f53f75d527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1aa3135-dd64-4bd2-b7ad-568f6d98d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1aa3135-dd64-4bd2-b7ad-568f6d98d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b97d41-bfc3-416f-aa21-0af4042811cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b97d41-bfc3-416f-aa21-0af4042811cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a20ef5-d50e-4528-be56-42554712a154', 'volume_name': 'volume-a6a20ef5-d50e-4528-be56-42554712a154', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf9bd31-39bf-4773-b48a-33d5273490d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf9bd31-39bf-4773-b48a-33d5273490d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb3664e-f03d-4b61-8481-c7efe2db5f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:51 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Volume a6a20ef5-d50e-4528-be56-42554712a154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a20ef5-d50e-4528-be56-42554712a154', 'volume_size': 1} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461645211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a20ef5-d50e-4528-be56-42554712a154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35977ad2dcb94ef990faef940d7c53ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:05:51Z,use_quota=True,user_id='eb7e769002224638b07f98f53f75d527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Creating volume a6a20ef5-d50e-4528-be56-42554712a154 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:05:51 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:51 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 1073741824 Jul 10 06:05:51 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-quobyte-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe390c2b-e63f-4b1d-875d-3053d81ef726]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:51 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 Jul 10 06:05:51 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:51 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Deleted volume successfully. Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4f022aba-58ce-41b3-bf2c-6187221b254f tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-ae61c6cd-2f76-4604-9a88-4f20bc4af7b7-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:52 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 1073741824" returned: 0 in 0.892s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:52 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 Jul 10 06:05:52 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:52 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7" returned: 0 in 0.861s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:52 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7 Jul 10 06:05:52 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:52 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154" returned: 0 in 0.670s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:05:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb3664e-f03d-4b61-8481-c7efe2db5f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a20ef5-d50e-4528-be56-42554712a154', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9a67c4-5523-4aa2-82bd-a964eb16cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:05:53 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Volume volume-a6a20ef5-d50e-4528-be56-42554712a154 (a6a20ef5-d50e-4528-be56-42554712a154): created successfully Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9a67c4-5523-4aa2-82bd-a964eb16cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Flow 'volume_create_manager' (1cfd8354-fb4a-43a5-8a8f-831373a31a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:05:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e86e37b3-9769-44de-a44e-3ca928b60abb tempest-ProjectReaderTests-2018550835 None] Created volume successfully. Jul 10 06:05:53 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7" returned: 0 in 0.682s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7" released by "delete_volume" :: held 1.594s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Acquiring lock "cinder-a6a20ef5-d50e-4528-be56-42554712a154-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Lock "cinder-a6a20ef5-d50e-4528-be56-42554712a154-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Acquiring lock "cinder-quobyte-a6a20ef5-d50e-4528-be56-42554712a154" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created reservations ['850bc7ae-fa5b-4a43-9020-6accc4fd2201', '2bab0b2b-d1cc-4501-ad75-f13d3f5d6a5b', '4cb47ae2-59af-4a84-a8cf-59e7cd7615ac', '08cef860-79a4-43cf-ad46-20b82e33e61f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Lock "cinder-quobyte-a6a20ef5-d50e-4528-be56-42554712a154" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8985153-8058-4ac2-bb18-9dcda91830fb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:53 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:53 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:53 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 Jul 10 06:05:53 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-8b48b11d-f63c-46ae-8e60-8089de74703b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-8b48b11d-f63c-46ae-8e60-8089de74703b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-quobyte-8b48b11d-f63c-46ae-8e60-8089de74703b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-8b48b11d-f63c-46ae-8e60-8089de74703b" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[90506b98-0ee6-42d1-9202-6de00c676b1f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:54 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b Jul 10 06:05:54 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:54 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.700s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Deleted volume successfully. Jul 10 06:05:54 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d41088bd-0ab6-442d-a5a9-44f5e77db449 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-b3ae91d9-49f4-42df-9bb9-f7f39fb5e3e7-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:54 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154 Jul 10 06:05:54 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:54 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b" returned: 0 in 0.796s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:54 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b Jul 10 06:05:54 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:55 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a6a20ef5-d50e-4528-be56-42554712a154" returned: 0 in 0.681s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Lock "cinder-quobyte-a6a20ef5-d50e-4528-be56-42554712a154" released by "delete_volume" :: held 1.537s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Created reservations ['6fa52ba7-d18c-42bf-ad49-3561449b7e75', '083289a2-997a-44b8-8535-5f29d7989eff', 'bb863617-cae1-4302-8cc9-40a8f548819b', 'eb1e1d0b-906b-4d3d-9768-96d1aee7be81'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:55 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:55 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:55 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-8b48b11d-f63c-46ae-8e60-8089de74703b" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-8b48b11d-f63c-46ae-8e60-8089de74703b" released by "delete_volume" :: held 1.509s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created reservations ['704c20a0-fd80-4e3b-b66a-1540088fe265', 'b0438650-f7d9-447a-bd71-ad8bff226d97', '14259c38-a472-4e58-9668-d402ad3f1558', '3fe0a7ef-57b1-4978-9ad8-73eba791db97'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:55 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:55 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:55 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.705s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Deleted volume successfully. Jul 10 06:05:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec628f7c-eafb-46cb-ab53-9eebaca81209 tempest-ProjectReaderTests-2018550835 None] Lock "cinder-a6a20ef5-d50e-4528-be56-42554712a154-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-6b6f07e1-4999-44b9-80a4-c0df9b952678-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-6b6f07e1-4999-44b9-80a4-c0df9b952678-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-quobyte-6b6f07e1-4999-44b9-80a4-c0df9b952678" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-6b6f07e1-4999-44b9-80a4-c0df9b952678" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b80f4-6616-4505-9240-2b19df65ad04]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:56 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.724s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:56 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 Jul 10 06:05:56 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Deleted volume successfully. Jul 10 06:05:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d67cc158-0364-48cc-9735-a5ddab3723b8 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-8b48b11d-f63c-46ae-8e60-8089de74703b-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:57 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678" returned: 0 in 0.859s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:57 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678 Jul 10 06:05:57 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:57 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6b6f07e1-4999-44b9-80a4-c0df9b952678" returned: 0 in 0.698s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-6b6f07e1-4999-44b9-80a4-c0df9b952678" released by "delete_volume" :: held 1.624s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:57 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created reservations ['048375cf-fe8b-481d-893a-42216aee142b', '189bf194-79ee-427f-8d77-ad9150e923df', '26c493fd-6f94-4e0a-87f1-c8e1dba43ac2', '7fecb0f3-66df-451d-866d-85390cbaffab'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:58 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:05:58 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-ceef0947-6e42-4d5f-899f-e17bdf98e3ba-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-ceef0947-6e42-4d5f-899f-e17bdf98e3ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "cinder-quobyte-ceef0947-6e42-4d5f-899f-e17bdf98e3ba" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-ceef0947-6e42-4d5f-899f-e17bdf98e3ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d68cb-0cd5-4219-b4b5-f6a33c0a6bb4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:58 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.725s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:05:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Deleted volume successfully. Jul 10 06:05:58 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba Jul 10 06:05:58 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:05:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c3a9e25-9ab8-4ae2-bd6b-e78a835c5ca6 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-6b6f07e1-4999-44b9-80a4-c0df9b952678-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:05:59 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 10 06:05:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba" returned: 0 in 0.828s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:05:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:05:59 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba Jul 10 06:05:59 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:00 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ceef0947-6e42-4d5f-899f-e17bdf98e3ba" returned: 0 in 0.715s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-quobyte-ceef0947-6e42-4d5f-899f-e17bdf98e3ba" released by "delete_volume" :: held 1.601s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Created reservations ['646a4ac2-d886-4e0b-b3cb-72323b1a5963', 'ed1911cb-bd76-46fa-828c-faaf20645556', 'd66c3cb8-64df-4a52-a576-5e43b78c8cae', 'ff6343f4-7755-440d-b9e3-712ea7754ce7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:00 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:00 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:01 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.746s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:01 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Deleted volume successfully. Jul 10 06:06:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-633c0176-b06d-42f2-a587-d18bc1c23dc0 tempest-CreateVolumesFromSourceVolumeTest-1968996530 None] Lock "cinder-ceef0947-6e42-4d5f-899f-e17bdf98e3ba-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Flow 'volume_create_manager' (d3c05ea5-e18c-42ba-88db-474b322895f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e9173a-7cf1-4c9b-89b9-df970f1f1280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e9173a-7cf1-4c9b-89b9-df970f1f1280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124467281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5afe37-98e2-4931-a862-d19197cfcb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243310fe79ca42aa96bc9526d1cab536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:04Z,use_quota=True,user_id='b7232bdab7d64b18a32c5832360bd035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c636151d-b431-4d27-a2e7-508c8bdd4e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c636151d-b431-4d27-a2e7-508c8bdd4e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ef0ade-f9a1-404d-a73a-3891629ba10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ef0ade-f9a1-404d-a73a-3891629ba10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5afe37-98e2-4931-a862-d19197cfcb50', 'volume_name': 'volume-1d5afe37-98e2-4931-a862-d19197cfcb50', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b57146d-9032-461e-8940-3bb537dde9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b57146d-9032-461e-8940-3bb537dde9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a6b90d-688d-429b-9bfc-289f28b86c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:03 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Volume 1d5afe37-98e2-4931-a862-d19197cfcb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5afe37-98e2-4931-a862-d19197cfcb50', 'volume_size': 1} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124467281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5afe37-98e2-4931-a862-d19197cfcb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243310fe79ca42aa96bc9526d1cab536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:04Z,use_quota=True,user_id='b7232bdab7d64b18a32c5832360bd035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Creating volume 1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:03 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:03 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 1073741824 Jul 10 06:06:03 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:04 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 1073741824" returned: 0 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:04 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:04 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:05 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a6b90d-688d-429b-9bfc-289f28b86c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5afe37-98e2-4931-a862-d19197cfcb50', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23541bd1-894b-4119-8c20-6501be1f0870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Volume volume-1d5afe37-98e2-4931-a862-d19197cfcb50 (1d5afe37-98e2-4931-a862-d19197cfcb50): created successfully Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23541bd1-894b-4119-8c20-6501be1f0870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Flow 'volume_create_manager' (d3c05ea5-e18c-42ba-88db-474b322895f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-35e4b91b-3b57-41be-b7b0-90fadd1557c7 tempest-VolumeDependencyTests-33904874 None] Created volume successfully. Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Creating offline snapshot d042c9f2-3230-4eba-af82-582d0fe32f48 of volume 1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2976ae2f-0b0b-4ded-87a0-c3fc7f441930]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:06 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:06 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:06 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.733s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:06 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 1G Jul 10 06:06:06 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:07 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 1G" returned: 0 in 0.778s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d5afe37-98e2-4931-a862-d19197cfcb50 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:07 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d5afe37-98e2-4931-a862-d19197cfcb50 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 Jul 10 06:06:07 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:08 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d5afe37-98e2-4931-a862-d19197cfcb50 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48" returned: 0 in 0.657s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:08 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 is being set with open permissions: ugo+rw Jul 10 06:06:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:08 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 Jul 10 06:06:08 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:08 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48" returned: 0 in 0.635s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:08 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info Jul 10 06:06:08 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:09 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info" returned: 0 in 0.659s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:09 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info is being set with open permissions: ugo+rw Jul 10 06:06:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:09 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info Jul 10 06:06:09 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:10 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.info" returned: 0 in 0.618s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-acfdbd80-6513-49ec-b645-b39f4c45fe99 tempest-VolumeDependencyTests-33904874 None] Create snapshot completed successfully Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Flow 'volume_create_manager' (b63cdf26-4665-4b8c-ba7e-39b4ec9d9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f376fc-8822-4c2e-8db5-c566e1aecbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f376fc-8822-4c2e-8db5-c566e1aecbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-273236023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57746cab-16e6-4db2-865e-116fc7a88277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243310fe79ca42aa96bc9526d1cab536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d042c9f2-3230-4eba-af82-582d0fe32f48,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:12Z,use_quota=True,user_id='b7232bdab7d64b18a32c5832360bd035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa678559-3043-444c-b66f-902191ff5b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa678559-3043-444c-b66f-902191ff5b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cec4745-36f9-4a60-9a31-54134ea7caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cec4745-36f9-4a60-9a31-54134ea7caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57746cab-16e6-4db2-865e-116fc7a88277', 'volume_name': 'volume-57746cab-16e6-4db2-865e-116fc7a88277', 'volume_size': 1, 'snapshot_id': 'd042c9f2-3230-4eba-af82-582d0fe32f48'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab305e04-3733-4583-8835-676a27a7c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab305e04-3733-4583-8835-676a27a7c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74128f34-b712-4e99-94cb-9ec72ddad0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:11 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Volume 57746cab-16e6-4db2-865e-116fc7a88277: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57746cab-16e6-4db2-865e-116fc7a88277', 'volume_size': 1, 'snapshot_id': 'd042c9f2-3230-4eba-af82-582d0fe32f48'} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-quobyte-d042c9f2-3230-4eba-af82-582d0fe32f48-57746cab-16e6-4db2-865e-116fc7a88277" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-d042c9f2-3230-4eba-af82-582d0fe32f48-57746cab-16e6-4db2-865e-116fc7a88277" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Creating volume 57746cab-16e6-4db2-865e-116fc7a88277 from snapshot d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-quobyte-57746cab-16e6-4db2-865e-116fc7a88277" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-57746cab-16e6-4db2-865e-116fc7a88277" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] snapshot: d042c9f2-3230-4eba-af82-582d0fe32f48, volume: 57746cab-16e6-4db2-865e-116fc7a88277, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c66f5c-cc52-443a-baa6-8d01aaac0626]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:12 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 Jul 10 06:06:12 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:12 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d5afe37-98e2-4931-a862-d19197cfcb50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:06:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:06:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:06:12 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d8932c-e27d-4096-bfc9-18b817d70239]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:12 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:12 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:13 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:13 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:06:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:13 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 Jul 10 06:06:13 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:18 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277" returned: 0 in 4.564s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:18 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013211d-4fd4-45b7-807e-1b4e12463850]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:18 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:18 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:19 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.918s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:06:19 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Converted 1024.00 MB image at 224.27 MB/s Jul 10 06:06:19 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 is being set with open permissions: ugo+rw Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:19 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 Jul 10 06:06:19 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:19 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277" returned: 0 in 0.639s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-57746cab-16e6-4db2-865e-116fc7a88277" released by "_copy_volume_from_snapshot" :: held 7.756s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-d042c9f2-3230-4eba-af82-582d0fe32f48-57746cab-16e6-4db2-865e-116fc7a88277" released by "_create_volume_from_snapshot" :: held 7.787s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.806s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=17,cinder:SELECT=112,cinder:UPDATE=166,cinder:INSERT=39 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=179,cinder:DELETE=16,cinder:SELECT=120,cinder:INSERT=41 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74128f34-b712-4e99-94cb-9ec72ddad0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57746cab-16e6-4db2-865e-116fc7a88277', 'volume_size': 1, 'snapshot_id': 'd042c9f2-3230-4eba-af82-582d0fe32f48'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41d1dee-adc2-4d8e-89ba-4b009f1a8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Volume volume-57746cab-16e6-4db2-865e-116fc7a88277 (57746cab-16e6-4db2-865e-116fc7a88277): created successfully Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41d1dee-adc2-4d8e-89ba-4b009f1a8a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Flow 'volume_create_manager' (b63cdf26-4665-4b8c-ba7e-39b4ec9d9431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dba7944e-4a7e-4663-a80a-81cc953c7b0a tempest-VolumeDependencyTests-33904874 None] Created volume successfully. Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-d042c9f2-3230-4eba-af82-582d0fe32f48-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-d042c9f2-3230-4eba-af82-582d0fe32f48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-quobyte-1d5afe37-98e2-4931-a862-d19197cfcb50" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-1d5afe37-98e2-4931-a862-d19197cfcb50" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-quobyte-d042c9f2-3230-4eba-af82-582d0fe32f48" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-d042c9f2-3230-4eba-af82-582d0fe32f48" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Deleting offline snapshot d042c9f2-3230-4eba-af82-582d0fe32f48 of volume 1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] snapshot_file for this snap is: volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7930d3de-3e41-4b14-8b7f-651f968d05db]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:20 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 Jul 10 06:06:20 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:21 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48" returned: 0 in 0.734s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d5afe37-98e2-4931-a862-d19197cfcb50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:06:21 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[54598f6d-b9eb-4cf6-87ac-7403f5f79e77]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:21 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:21 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:22 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.792s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:22 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 Jul 10 06:06:22 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:22 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48" returned: 0 in 0.695s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:22 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48 Jul 10 06:06:22 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:23 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50.d042c9f2-3230-4eba-af82-582d0fe32f48" returned: 0 in 0.642s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-d042c9f2-3230-4eba-af82-582d0fe32f48" released by "_delete_snapshot" :: held 2.961s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-1d5afe37-98e2-4931-a862-d19197cfcb50" released by "delete_snapshot" :: held 2.986s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Created reservations ['e3bb59c4-a809-455c-9685-cfeefd90d06f', 'cd5c7bc4-4198-400b-bbf9-3f8840021a7d', 'fd24b6b4-fcfb-4a92-a5db-5a3d78232e3b', '92064b1b-325b-4ce4-bacd-3a4079c5ef4e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:23 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Delete snapshot completed successfully. Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-fd1bb86b-a7f7-4c9c-af6b-c459adc3ef58 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-d042c9f2-3230-4eba-af82-582d0fe32f48-delete_snapshot" released by "delete_snapshot" :: held 3.123s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-1d5afe37-98e2-4931-a862-d19197cfcb50-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-1d5afe37-98e2-4931-a862-d19197cfcb50-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-quobyte-1d5afe37-98e2-4931-a862-d19197cfcb50" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-1d5afe37-98e2-4931-a862-d19197cfcb50" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[54096d2c-a404-4b06-81f6-5a8aa4afb07e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:23 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:23 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:24 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.748s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:24 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50 Jul 10 06:06:24 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:25 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1d5afe37-98e2-4931-a862-d19197cfcb50" returned: 0 in 0.653s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-1d5afe37-98e2-4931-a862-d19197cfcb50" released by "delete_volume" :: held 1.455s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Created reservations ['adc3a23f-2ea9-46b9-a638-ab61347875d4', 'a7247447-fc70-4ad4-b2f5-f93f51dd8303', '3a532749-29dd-47ac-8312-a09fe4cddd00', 'e674203a-63d6-4a98-b129-88146917342e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:25 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:25 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-57746cab-16e6-4db2-865e-116fc7a88277-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-57746cab-16e6-4db2-865e-116fc7a88277-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:25 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.627s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Deleted volume successfully. Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "cinder-quobyte-57746cab-16e6-4db2-865e-116fc7a88277" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6acdeda2-5ddb-430b-bfce-359249d83c98 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-1d5afe37-98e2-4931-a862-d19197cfcb50-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-57746cab-16e6-4db2-865e-116fc7a88277" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f5ea24-bc74-40ba-aba4-26357eccb133]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:26 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 Jul 10 06:06:26 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:26 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277" returned: 0 in 0.748s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:26 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277 Jul 10 06:06:26 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:27 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-57746cab-16e6-4db2-865e-116fc7a88277" returned: 0 in 0.677s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-quobyte-57746cab-16e6-4db2-865e-116fc7a88277" released by "delete_volume" :: held 1.466s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Created reservations ['7af57a74-c56b-4e4b-82ae-d24d25228853', 'c9ffa10c-fd9d-443e-b38d-c0b9e86c136b', '0a2bff84-f04b-4b01-8ef8-7bd6cbdc4128', 'd6b1ee6b-003d-421b-aff2-96aec9a3ceab'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:27 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:27 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:28 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.653s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Deleted volume successfully. Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-256a9308-6ac9-4248-b158-b3ce30a00f83 tempest-VolumeDependencyTests-33904874 None] Lock "cinder-57746cab-16e6-4db2-865e-116fc7a88277-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:28 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:28 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:29 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.705s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:06:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:06:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:06:37 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=1,cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=26 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:06:38 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=19,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Flow 'volume_create_manager' (bcd236fd-5a1f-4140-9fe8-6a47411a6efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ccfeea-4cfa-46db-b188-6f29b8ac28aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ccfeea-4cfa-46db-b188-6f29b8ac28aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6911d60d-43cc-4ede-b04e-ee7907fc0e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba929919f60f43bfba81a27d4ea11d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:40Z,use_quota=True,user_id='fc47a9aefaf5403cb7a9c811587d7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49708d0d-6bdb-4f65-8de2-4248ebd45b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49708d0d-6bdb-4f65-8de2-4248ebd45b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791468e4-8c0a-4808-ac0a-38c4c6d465e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791468e4-8c0a-4808-ac0a-38c4c6d465e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6911d60d-43cc-4ede-b04e-ee7907fc0e2a', 'volume_name': 'volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1b3d81-8dbf-4c96-a49c-1b3736f6c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1b3d81-8dbf-4c96-a49c-1b3736f6c4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77e8beb-0a67-4ed5-8d17-1b89a7a892a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Volume 6911d60d-43cc-4ede-b04e-ee7907fc0e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a', 'volume_size': 1} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6911d60d-43cc-4ede-b04e-ee7907fc0e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba929919f60f43bfba81a27d4ea11d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:40Z,use_quota=True,user_id='fc47a9aefaf5403cb7a9c811587d7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Creating volume 6911d60d-43cc-4ede-b04e-ee7907fc0e2a {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:40 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:40 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a 1073741824 Jul 10 06:06:40 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (7ee79d2b-ddd1-4638-98cf-39381090136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e63839-82ed-4a56-b14f-77f4574b4596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e63839-82ed-4a56-b14f-77f4574b4596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282729148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd52605e-6706-47d4-8aca-314282227ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:41Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc39525-4e69-4ddc-947f-efa73e0583dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc39525-4e69-4ddc-947f-efa73e0583dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f80218-3e0a-4f5d-abd5-fa6545718cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f80218-3e0a-4f5d-abd5-fa6545718cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd52605e-6706-47d4-8aca-314282227ba0', 'volume_name': 'volume-cd52605e-6706-47d4-8aca-314282227ba0', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e507bdb7-4485-44c1-a93d-f353f618b46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e507bdb7-4485-44c1-a93d-f353f618b46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1242406-446a-4e04-987e-35677a615f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:40 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Volume cd52605e-6706-47d4-8aca-314282227ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd52605e-6706-47d4-8aca-314282227ba0', 'volume_size': 1} Jul 10 06:06:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (e886e6ea-6e80-4eb0-8775-772db01fae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3259cf96-8f62-4523-8a0b-54444bceac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3259cf96-8f62-4523-8a0b-54444bceac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144801545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b9b59a-ae32-4a96-839f-87a9e11e0d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:41Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58b4fd-bfa7-4e06-b8a5-78d147d1545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58b4fd-bfa7-4e06-b8a5-78d147d1545d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af7850b-fbfe-49d0-85b5-28c2ce231ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af7850b-fbfe-49d0-85b5-28c2ce231ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b9b59a-ae32-4a96-839f-87a9e11e0d21', 'volume_name': 'volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b72dd21-e374-42bd-917f-4b951814d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b72dd21-e374-42bd-917f-4b951814d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44828e25-6feb-48f7-9686-6adb31b7b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Volume 76b9b59a-ae32-4a96-839f-87a9e11e0d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21', 'volume_size': 1} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (4242da31-5b6f-40c1-8626-6ddcc0ca4aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c11fcb-c3d6-4b3c-bf71-c52bce509d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ea732d8c-d007-4d6b-9801-9ef8c6a8d72e tempest-ProjectAdminTests-1423445371 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87449) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c11fcb-c3d6-4b3c-bf71-c52bce509d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1877867301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:41Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541141f3-7c29-4d2a-a134-c8ffc94001d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541141f3-7c29-4d2a-a134-c8ffc94001d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd988a1-f17d-4b01-927e-86dc8c183d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd988a1-f17d-4b01-927e-86dc8c183d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1', 'volume_name': 'volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405a63f3-6066-4e6d-b182-c7bc0168893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405a63f3-6066-4e6d-b182-c7bc0168893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367aff8c-fa03-48ff-9a08-49a7a2684023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Volume 89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1', 'volume_size': 1} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:41 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a 1073741824" returned: 0 in 1.134s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:41 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a Jul 10 06:06:41 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (2cd60bb7-2c28-48f7-a911-2cc7d19a8bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0970f3bc-9842-4052-b3e3-be7fe02be231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0970f3bc-9842-4052-b3e3-be7fe02be231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1972626584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81d3bce-e16b-4dad-a3c7-5434fd7e640b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:42Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f67b33-7ad2-4f7b-96d3-658393c9e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f67b33-7ad2-4f7b-96d3-658393c9e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992f89ea-706d-46a1-9141-46ad062119a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992f89ea-706d-46a1-9141-46ad062119a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c81d3bce-e16b-4dad-a3c7-5434fd7e640b', 'volume_name': 'volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4176533e-cc46-44aa-aab8-a9dd29ae2678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4176533e-cc46-44aa-aab8-a9dd29ae2678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227948c0-d130-4bbc-b338-86f215da3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Volume c81d3bce-e16b-4dad-a3c7-5434fd7e640b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b', 'volume_size': 1} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:42 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a" returned: 0 in 0.850s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282729148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd52605e-6706-47d4-8aca-314282227ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:41Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Creating volume cd52605e-6706-47d4-8aca-314282227ba0 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:42 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:42 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 1073741824 Jul 10 06:06:42 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77e8beb-0a67-4ed5-8d17-1b89a7a892a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f8f17c-78f1-4a23-9c11-4d8c57cd2856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (be7cced1-978a-484a-8e46-421783fa6940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2028516-b674-4432-87bb-7b32df46e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2028516-b674-4432-87bb-7b32df46e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232547057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197142f1-1122-4dae-92c5-126eee0ba4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:43Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4cc41e-82ba-4853-8ca9-8ebba2303fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4cc41e-82ba-4853-8ca9-8ebba2303fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8df49b-7015-41eb-85c3-6e905f735302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8df49b-7015-41eb-85c3-6e905f735302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197142f1-1122-4dae-92c5-126eee0ba4f9', 'volume_name': 'volume-197142f1-1122-4dae-92c5-126eee0ba4f9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c212b5af-aad4-44a0-81d3-31efa1c336fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c212b5af-aad4-44a0-81d3-31efa1c336fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494c0fa1-4bd2-4456-a164-c16d53e39eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:42 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Volume 197142f1-1122-4dae-92c5-126eee0ba4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197142f1-1122-4dae-92c5-126eee0ba4f9', 'volume_size': 1} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:42 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Volume volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a (6911d60d-43cc-4ede-b04e-ee7907fc0e2a): created successfully Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f8f17c-78f1-4a23-9c11-4d8c57cd2856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Flow 'volume_create_manager' (bcd236fd-5a1f-4140-9fe8-6a47411a6efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:42 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0ba9a6d2-2039-4d99-82c2-ad3732768dfb tempest-CinderUnicodeTest-690887554 None] Created volume successfully. Jul 10 06:06:43 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 1073741824" returned: 0 in 0.995s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:43 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 Jul 10 06:06:43 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Flow 'volume_create_manager' (24f7d8fd-817b-4fce-aed2-88b163ce860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360ff8bd-e98d-4e21-844e-5a49e03521af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360ff8bd-e98d-4e21-844e-5a49e03521af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1746589734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154d353f-1694-4fdd-ba93-fb0b3caaf369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba929919f60f43bfba81a27d4ea11d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:44Z,use_quota=True,user_id='fc47a9aefaf5403cb7a9c811587d7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3d8db-92ee-465c-bcdd-bfd2867a8af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3d8db-92ee-465c-bcdd-bfd2867a8af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10b537e-eacb-4dc4-9661-284034d449fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10b537e-eacb-4dc4-9661-284034d449fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154d353f-1694-4fdd-ba93-fb0b3caaf369', 'volume_name': 'volume-154d353f-1694-4fdd-ba93-fb0b3caaf369', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6660bfc9-f0a3-42af-a85a-3cc9e27a4d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6660bfc9-f0a3-42af-a85a-3cc9e27a4d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c884017-b555-4bc6-9ef9-2b13fcf31141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Volume 154d353f-1694-4fdd-ba93-fb0b3caaf369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154d353f-1694-4fdd-ba93-fb0b3caaf369', 'volume_size': 1} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:44 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0" returned: 0 in 0.859s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.107s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144801545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b9b59a-ae32-4a96-839f-87a9e11e0d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:41Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Creating volume 76b9b59a-ae32-4a96-839f-87a9e11e0d21 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:44 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:44 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 1073741824 Jul 10 06:06:44 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1242406-446a-4e04-987e-35677a615f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd52605e-6706-47d4-8aca-314282227ba0', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da97f42-f101-40bd-8969-8608f2bbba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Volume volume-cd52605e-6706-47d4-8aca-314282227ba0 (cd52605e-6706-47d4-8aca-314282227ba0): created successfully Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da97f42-f101-40bd-8969-8608f2bbba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (7ee79d2b-ddd1-4638-98cf-39381090136e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-81d42bd7-e129-476b-8c35-738054ba498c tempest-CreateVolumesFromImageTest-964841951 None] Created volume successfully. Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Flow 'volume_create_manager' (54200c4f-7dcd-4f04-a0ae-728570a35ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c629953-a16c-48df-b4a5-ca5f9c0cc737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c629953-a16c-48df-b4a5-ca5f9c0cc737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431ed8ac-04ff-42cc-a5c7-f9fc01403801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187a63c5c817474281cb82b63e51c542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:45Z,use_quota=True,user_id='2fc9307d760041489842d22d194a69d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89d15f07-c238-44a5-9d64-06d8aefca4db),volume_type_id=89d15f07-c238-44a5-9d64-06d8aefca4db)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17e5bac-4128-40d6-a98d-766a7f6a34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17e5bac-4128-40d6-a98d-766a7f6a34c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce3821-4dc5-4189-b92e-d61e8294669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:06:45 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 1073741824" returned: 0 in 1.019s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:45 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 Jul 10 06:06:45 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce3821-4dc5-4189-b92e-d61e8294669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '431ed8ac-04ff-42cc-a5c7-f9fc01403801', 'volume_name': 'volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801', 'volume_size': 1, 'image_id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40dff341-1ec5-4a0b-acd8-0322ec43f578', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99c4ddd5ce187eeea3300affce6212ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '187a63c5c817474281cb82b63e51c542', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5805364c0515095d134123b1a8231b841a528a62c610ec45b37f0b02f8aa665c627b09d189ea3e6b36be8504e46fcba9f62e9b550c11eb5dd50568bbab0e48c2', 'id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'created_at': datetime.datetime(2026, 7, 10, 4, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40dff341-1ec5-4a0b-acd8-0322ec43f578/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1d6a8e-eb26-4197-9a61-6da732df06d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1d6a8e-eb26-4197-9a61-6da732df06d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e92b9ac-12b2-4235-a210-5b349c250f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:45 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Volume 431ed8ac-04ff-42cc-a5c7-f9fc01403801: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801', 'volume_size': 1, 'image_id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40dff341-1ec5-4a0b-acd8-0322ec43f578', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99c4ddd5ce187eeea3300affce6212ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '187a63c5c817474281cb82b63e51c542', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5805364c0515095d134123b1a8231b841a528a62c610ec45b37f0b02f8aa665c627b09d189ea3e6b36be8504e46fcba9f62e9b550c11eb5dd50568bbab0e48c2', 'id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'created_at': datetime.datetime(2026, 7, 10, 4, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40dff341-1ec5-4a0b-acd8-0322ec43f578/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Trying to clone 431ed8ac-04ff-42cc-a5c7-f9fc01403801 from image 40dff341-1ec5-4a0b-acd8-0322ec43f578 at location (None, [{'url': 'file:///opt/stack/data/glance/images/40dff341-1ec5-4a0b-acd8-0322ec43f578', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:06:45 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:06:45 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[157c7e0a-a22a-49de-8197-1fd659aad6a8]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:46 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD Jul 10 06:06:46 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:46 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21" returned: 0 in 0.776s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.713s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1877867301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:41Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Creating volume 89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:46 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44828e25-6feb-48f7-9686-6adb31b7b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:46 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 1073741824 Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1767e6ea-4e85-4336-bad8-e317e3e399c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:46 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:46 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Volume volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 (76b9b59a-ae32-4a96-839f-87a9e11e0d21): created successfully Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1767e6ea-4e85-4336-bad8-e317e3e399c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (e886e6ea-6e80-4eb0-8775-772db01fae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f2b6637a-aa1b-497f-9bd5-f74b3b631aef tempest-CreateVolumesFromImageTest-964841951 None] Created volume successfully. Jul 10 06:06:46 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD" returned: 0 in 0.794s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:46 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD Jul 10 06:06:46 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:47 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 1073741824" returned: 0 in 0.898s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:47 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 Jul 10 06:06:47 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:47 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD" returned: 1 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Temporary image 40dff341-1ec5-4a0b-acd8-0322ec43f578 is fetched for user 2fc9307d760041489842d22d194a69d8. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26637da-0530-47c7-adcf-7088140ad578]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:47 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD Jul 10 06:06:47 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:48 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1" returned: 0 in 0.713s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.784s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1972626584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81d3bce-e16b-4dad-a3c7-5434fd7e640b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:42Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Creating volume c81d3bce-e16b-4dad-a3c7-5434fd7e640b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:48 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367aff8c-fa03-48ff-9a08-49a7a2684023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:48 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b 1073741824 Jul 10 06:06:48 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d160f5e8-5d80-4086-836f-a20dbe1b68e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:48 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Volume volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 (89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1): created successfully Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d160f5e8-5d80-4086-836f-a20dbe1b68e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (4242da31-5b6f-40c1-8626-6ddcc0ca4aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-50b4355c-3d62-4111-8c5f-8b68d2c0c4cf tempest-CreateVolumesFromImageTest-964841951 None] Created volume successfully. Jul 10 06:06:48 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:48 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD Jul 10 06:06:48 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:49 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b 1073741824" returned: 0 in 1.006s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:49 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b Jul 10 06:06:49 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:49 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD" returned: 1 in 0.859s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:49 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b" returned: 0 in 0.722s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.050s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232547057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197142f1-1122-4dae-92c5-126eee0ba4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed267cc83ce432f8262f931acb825bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:43Z,use_quota=True,user_id='972e4e7e79384174b0d92e77f6b8dc44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Creating volume 197142f1-1122-4dae-92c5-126eee0ba4f9 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:49 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227948c0-d130-4bbc-b338-86f215da3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:49 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 1073741824 Jul 10 06:06:49 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86756b37-3d45-4482-bd9a-4bdb53a21fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:49 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Volume volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b (c81d3bce-e16b-4dad-a3c7-5434fd7e640b): created successfully Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86756b37-3d45-4482-bd9a-4bdb53a21fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (2cd60bb7-2c28-48f7-a911-2cc7d19a8bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-62ef67f5-574b-4947-9aa3-8cbc9f63ab96 tempest-CreateVolumesFromImageTest-964841951 None] Created volume successfully. Jul 10 06:06:50 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 1073741824" returned: 0 in 0.889s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:50 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 Jul 10 06:06:50 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:51 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9" returned: 0 in 0.668s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.991s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1746589734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154d353f-1694-4fdd-ba93-fb0b3caaf369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba929919f60f43bfba81a27d4ea11d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:44Z,use_quota=True,user_id='fc47a9aefaf5403cb7a9c811587d7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Creating volume 154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:51 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494c0fa1-4bd2-4456-a164-c16d53e39eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197142f1-1122-4dae-92c5-126eee0ba4f9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435cbde2-b9b1-44cf-bf37-1d7c5e1ab8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:51 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 1073741824 Jul 10 06:06:51 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:51 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Volume volume-197142f1-1122-4dae-92c5-126eee0ba4f9 (197142f1-1122-4dae-92c5-126eee0ba4f9): created successfully Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435cbde2-b9b1-44cf-bf37-1d7c5e1ab8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Flow 'volume_create_manager' (be7cced1-978a-484a-8e46-421783fa6940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-41cd43be-b1d6-4d45-a7aa-473a3a98c431 tempest-CreateVolumesFromImageTest-964841951 None] Created volume successfully. Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (ab939129-249c-419c-9a04-06985b76e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b59e002-8360-4967-968e-59f864ffbb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b59e002-8360-4967-968e-59f864ffbb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056001788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bc0354-de04-4417-80bb-c7366d3d7f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:51Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bca5cc-9599-407b-8234-4f8fa60a7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bca5cc-9599-407b-8234-4f8fa60a7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff117364-d49e-46b8-8dc1-112f84229145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff117364-d49e-46b8-8dc1-112f84229145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bc0354-de04-4417-80bb-c7366d3d7f89', 'volume_name': 'volume-97bc0354-de04-4417-80bb-c7366d3d7f89', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5e1659-f9e6-4007-a843-dc3ad3fc5fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5e1659-f9e6-4007-a843-dc3ad3fc5fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbc2991-eb5f-42d5-9082-7ef48c384203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:51 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Volume 97bc0354-de04-4417-80bb-c7366d3d7f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bc0354-de04-4417-80bb-c7366d3d7f89', 'volume_size': 1} Jul 10 06:06:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:52 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 1073741824" returned: 0 in 0.835s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:52 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 Jul 10 06:06:52 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-197142f1-1122-4dae-92c5-126eee0ba4f9-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-197142f1-1122-4dae-92c5-126eee0ba4f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-quobyte-197142f1-1122-4dae-92c5-126eee0ba4f9" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-197142f1-1122-4dae-92c5-126eee0ba4f9" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e35a38-a346-40f0-8dd3-bc0ed46660d4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:52 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 Jul 10 06:06:52 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:53 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369" returned: 0 in 0.712s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.580s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431ed8ac-04ff-42cc-a5c7-f9fc01403801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187a63c5c817474281cb82b63e51c542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:45Z,use_quota=True,user_id='2fc9307d760041489842d22d194a69d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89d15f07-c238-44a5-9d64-06d8aefca4db),volume_type_id=89d15f07-c238-44a5-9d64-06d8aefca4db)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Creating volume 431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:53 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:53 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 1073741824 Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c884017-b555-4bc6-9ef9-2b13fcf31141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154d353f-1694-4fdd-ba93-fb0b3caaf369', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:53 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f961af-64df-4a17-858a-e9be49db3021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:53 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Volume volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 (154d353f-1694-4fdd-ba93-fb0b3caaf369): created successfully Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f961af-64df-4a17-858a-e9be49db3021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Flow 'volume_create_manager' (24f7d8fd-817b-4fce-aed2-88b163ce860e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4d8aac16-3aae-4b7b-841f-280a8999ace7 tempest-CinderUnicodeTest-690887554 None] Created volume successfully. Jul 10 06:06:53 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9" returned: 0 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:53 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9 Jul 10 06:06:53 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:53 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 1073741824" returned: 0 in 0.875s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:53 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:06:53 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:54 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-197142f1-1122-4dae-92c5-126eee0ba4f9" returned: 0 in 0.775s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-197142f1-1122-4dae-92c5-126eee0ba4f9" released by "delete_volume" :: held 1.622s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Created reservations ['81811305-9538-4691-a678-ee844454b102', '51e9797e-a37f-451f-9158-b490afbdb891', 'e07b4be1-af94-4b3c-9b1a-3eadf735829e', 'bf0c8102-a7a1-4bbd-81e6-7d2b54e388d6'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:54 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:54 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:54 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 0 in 0.706s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056001788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bc0354-de04-4417-80bb-c7366d3d7f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:06:51Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Creating volume 97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:06:54 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:54 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 1073741824 Jul 10 06:06:54 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-c81d3bce-e16b-4dad-a3c7-5434fd7e640b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Attempting download of 40dff341-1ec5-4a0b-acd8-0322ec43f578 ((None, [{'url': 'file:///opt/stack/data/glance/images/40dff341-1ec5-4a0b-acd8-0322ec43f578', 'metadata': {}}])) to volume 431ed8ac-04ff-42cc-a5c7-f9fc01403801. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-c81d3bce-e16b-4dad-a3c7-5434fd7e640b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-quobyte-c81d3bce-e16b-4dad-a3c7-5434fd7e640b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[62189621-1be1-4bf4-9735-0647c1b8305a]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-c81d3bce-e16b-4dad-a3c7-5434fd7e640b" acquired by "delete_volume" :: waited 0.050s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1f39a-f03e-4c67-a8e9-b75253a2bc04]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:54 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0 Jul 10 06:06:54 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:55 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:55 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.735s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:55 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Deleted volume successfully. Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d91b3645-78b0-4917-a248-075ee830457c tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-197142f1-1122-4dae-92c5-126eee0ba4f9-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:55 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 1073741824" returned: 0 in 0.952s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:55 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0" returned: 0 in 0.809s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:55 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 Jul 10 06:06:55 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:55 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0 Jul 10 06:06:55 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:55 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b" returned: 0 in 0.888s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:55 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b Jul 10 06:06:55 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:56 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89" returned: 0 in 0.689s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.180s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Creating offline snapshot e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c of volume 154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbc2991-eb5f-42d5-9082-7ef48c384203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bc0354-de04-4417-80bb-c7366d3d7f89', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b934d54-13c7-4f6c-a993-df72974e05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1281cd9b-f25b-49d1-8c22-4ff02ce1779a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:56 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:56 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Volume volume-97bc0354-de04-4417-80bb-c7366d3d7f89 (97bc0354-de04-4417-80bb-c7366d3d7f89): created successfully Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b934d54-13c7-4f6c-a993-df72974e05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (ab939129-249c-419c-9a04-06985b76e00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0" returned: 1 in 0.820s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40dff341-1ec5-4a0b-acd8-0322ec43f578_17xg_we0' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a4db3-5df0-4eaf-96a5-c2d3081c2d5a]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e3f7aca8-bc3e-4fa9-b014-82f40af9a1d6 tempest-ProjectReaderTests-1558325439 None] Created volume successfully. Jul 10 06:06:56 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c81d3bce-e16b-4dad-a3c7-5434fd7e640b" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:56 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 Jul 10 06:06:56 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-c81d3bce-e16b-4dad-a3c7-5434fd7e640b" released by "delete_volume" :: held 1.686s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:56 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD Jul 10 06:06:56 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Created reservations ['bca0e714-9c33-41b5-9690-ae6c67360981', 'd3ffb93a-f3f4-4aeb-a37e-d01ac1be3fb5', 'b922645f-199d-43bc-8088-c5fdc8b6892a', '7cceee18-df36-4c80-ae5c-8ca0fba57d26'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:56 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:56 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-quobyte-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054932b-e0db-4f37-9082-44e2e1f51706]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:57 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD" returned: 0 in 0.878s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:57 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 Jul 10 06:06:57 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:57 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369" returned: 0 in 1.029s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:57 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD Jul 10 06:06:57 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:57 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c 1G Jul 10 06:06:57 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:57 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.818s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Deleted volume successfully. Jul 10 06:06:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-44a7658b-7c96-40bf-af8c-2aa64adc764d tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-c81d3bce-e16b-4dad-a3c7-5434fd7e640b-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:58 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD" returned: 1 in 0.794s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] 40dff341-1ec5-4a0b-acd8-0322ec43f578 was raw, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:58 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:06:58 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:58 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1" returned: 0 in 0.909s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:58 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1 Jul 10 06:06:58 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:58 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c 1G" returned: 0 in 0.976s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:58 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c Jul 10 06:06:58 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:58 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1" returned: 0 in 0.711s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1" released by "delete_volume" :: held 1.698s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:58 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 0 in 0.816s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40dff341-1ec5-4a0b-acd8-0322ec43f578_hzz3q1d3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:06:58 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:58 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Created reservations ['9ed60cd6-2e14-44a0-a02e-6ab3c8c8a80f', 'adb55779-9f0b-4765-8690-746820d6bdff', '8fe8be6d-41be-4c2d-8b9c-dc2ce971efa3', '6a265053-f908-403d-a5c5-ace10ee407ed'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:06:58 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 1G Jul 10 06:06:59 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:59 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:06:59 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:59 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" returned: 0 in 0.778s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:59 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c is being set with open permissions: ugo+rw Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:59 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c Jul 10 06:06:59 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-76b9b59a-ae32-4a96-839f-87a9e11e0d21-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-76b9b59a-ae32-4a96-839f-87a9e11e0d21-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-quobyte-76b9b59a-ae32-4a96-839f-87a9e11e0d21" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-76b9b59a-ae32-4a96-839f-87a9e11e0d21" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[529ab83b-7693-4a5a-9c85-a5b371aec9a4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:59 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 Jul 10 06:06:59 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:59 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 1G" returned: 0 in 0.820s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:59 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.737s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:06:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Deleted volume successfully. Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[de695b6b-4b13-45d9-91f7-4882cdf8e4e6]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:06:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b09ebecd-2c87-4440-9d8b-fdb825c23b6b tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-89ec1d6d-7a0b-41ce-b9a0-57f721c5a3a1-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:06:59 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:06:59 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:06:59 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" returned: 0 in 0.787s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:00 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info Jul 10 06:07:00 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:00 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21" returned: 0 in 0.819s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:00 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21 Jul 10 06:07:00 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:00 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 0 in 0.804s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:00 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:07:00 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:00 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info" returned: 0 in 0.744s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:00 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info is being set with open permissions: ugo+rw Jul 10 06:07:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:00 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info Jul 10 06:07:00 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:01 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-76b9b59a-ae32-4a96-839f-87a9e11e0d21" returned: 0 in 0.700s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-76b9b59a-ae32-4a96-839f-87a9e11e0d21" released by "delete_volume" :: held 1.571s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Created reservations ['87120353-efb4-421c-8ebc-73e834b38e8c', '708ba2e8-51fb-457b-b99b-585f104998b6', '71e9bf32-4d47-4421-8635-0452f8b3ffdd', 'dd8f3b6c-3382-4b2c-9925-5c353d7e0974'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:01 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:01 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:01 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 1 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Downloaded image 40dff341-1ec5-4a0b-acd8-0322ec43f578 ((None, [{'url': 'file:///opt/stack/data/glance/images/40dff341-1ec5-4a0b-acd8-0322ec43f578', 'metadata': {}}])) to volume 431ed8ac-04ff-42cc-a5c7-f9fc01403801 successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Temporary image 40dff341-1ec5-4a0b-acd8-0322ec43f578 for user 2fc9307d760041489842d22d194a69d8 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Marking volume 431ed8ac-04ff-42cc-a5c7-f9fc01403801 as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Copying metadata from image 40dff341-1ec5-4a0b-acd8-0322ec43f578 to 431ed8ac-04ff-42cc-a5c7-f9fc01403801. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Creating volume glance metadata for volume 431ed8ac-04ff-42cc-a5c7-f9fc01403801 backed by image 40dff341-1ec5-4a0b-acd8-0322ec43f578 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '99c4ddd5ce187eeea3300affce6212ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:07:01 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.info" returned: 0 in 0.753s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.178s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.470s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Creating offline snapshot 7f361a67-ad50-40b4-813a-4da049a2b365 of volume 97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:07:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b27c5274-9451-456d-9c23-f135289c9e00 tempest-CinderUnicodeTest-690887554 None] Create snapshot completed successfully Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4dde3-2432-499b-b1c2-0612d50e323f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e92b9ac-12b2-4235-a210-5b349c250f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801', 'volume_size': 1, 'image_id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40dff341-1ec5-4a0b-acd8-0322ec43f578', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99c4ddd5ce187eeea3300affce6212ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '187a63c5c817474281cb82b63e51c542', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5805364c0515095d134123b1a8231b841a528a62c610ec45b37f0b02f8aa665c627b09d189ea3e6b36be8504e46fcba9f62e9b550c11eb5dd50568bbab0e48c2', 'id': '40dff341-1ec5-4a0b-acd8-0322ec43f578', 'created_at': datetime.datetime(2026, 7, 10, 4, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 6, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40dff341-1ec5-4a0b-acd8-0322ec43f578/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e68a14-b61b-4c2f-8a79-c6a9657402eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-cd52605e-6706-47d4-8aca-314282227ba0-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-cd52605e-6706-47d4-8aca-314282227ba0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Volume volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 (431ed8ac-04ff-42cc-a5c7-f9fc01403801): created successfully Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e68a14-b61b-4c2f-8a79-c6a9657402eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Flow 'volume_create_manager' (54200c4f-7dcd-4f04-a0ae-728570a35ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-920fef12-82ab-47f3-b6a3-1310cd4cd9e9 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Created volume successfully. Jul 10 06:07:01 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 Jul 10 06:07:01 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "cinder-quobyte-cd52605e-6706-47d4-8aca-314282227ba0" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-cd52605e-6706-47d4-8aca-314282227ba0" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f471d04-3c53-42aa-bbfe-ace49695ee98]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:02 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 Jul 10 06:07:02 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:02 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.895s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Deleted volume successfully. Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-39174116-7c55-48df-8094-16c3352c422f tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-76b9b59a-ae32-4a96-839f-87a9e11e0d21-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Acquiring lock "cinder-431ed8ac-04ff-42cc-a5c7-f9fc01403801-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "cinder-431ed8ac-04ff-42cc-a5c7-f9fc01403801-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Acquiring lock "cinder-quobyte-431ed8ac-04ff-42cc-a5c7-f9fc01403801" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "cinder-quobyte-431ed8ac-04ff-42cc-a5c7-f9fc01403801" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:02 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89" returned: 0 in 1.004s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:02 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 1G Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-quobyte-154d353f-1694-4fdd-ba93-fb0b3caaf369" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:02 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7dc8e7-c5d1-4c6e-81a8-e32e9c08059f]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-154d353f-1694-4fdd-ba93-fb0b3caaf369" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-quobyte-e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Deleting offline snapshot e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c of volume 154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] snapshot_file for this snap is: volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f75e04-ecfb-4662-94c1-937b9a70e1b5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:02 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0" returned: 0 in 0.870s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:02 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:07:02 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:02 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0 Jul 10 06:07:02 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:02 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c Jul 10 06:07:02 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:03 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cd52605e-6706-47d4-8aca-314282227ba0" returned: 0 in 0.745s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-quobyte-cd52605e-6706-47d4-8aca-314282227ba0" released by "delete_volume" :: held 1.675s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:03 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 0 in 0.912s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:03 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 1G" returned: 0 in 1.011s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bc0354-de04-4417-80bb-c7366d3d7f89 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:03 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" returned: 0 in 0.887s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-154d353f-1694-4fdd-ba93-fb0b3caaf369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:07:03 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bc0354-de04-4417-80bb-c7366d3d7f89 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 Jul 10 06:07:03 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b28f1a3-65fe-4736-a23d-c19ad2e9ef0b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Created reservations ['c40857fa-7961-49e1-8bed-68eccc7f8c39', 'a3633e31-25d5-4544-937a-070fef1b7cae', '42929d43-3b56-41d2-bd13-ecfad53dd08b', '03c90b37-cafb-4933-b5e5-a35680b6bbe2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:03 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:07:03 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:03 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:03 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:03 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 Jul 10 06:07:03 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:04 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 1 in 1.000s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:04 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801 Jul 10 06:07:04 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:04 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.841s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:04 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Deleted volume successfully. Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-803ee2c0-4f20-4abc-8a1f-e65545495d89 tempest-CreateVolumesFromImageTest-964841951 None] Lock "cinder-cd52605e-6706-47d4-8aca-314282227ba0-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:04 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bc0354-de04-4417-80bb-c7366d3d7f89 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365" returned: 0 in 1.113s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:04 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 is being set with open permissions: ugo+rw Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:04 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 Jul 10 06:07:04 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:04 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369" returned: 0 in 1.123s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:04 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c Jul 10 06:07:04 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:05 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-431ed8ac-04ff-42cc-a5c7-f9fc01403801" returned: 0 in 0.787s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "cinder-quobyte-431ed8ac-04ff-42cc-a5c7-f9fc01403801" released by "delete_volume" :: held 2.800s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Created reservations ['508fedd8-64ea-4a91-85aa-b30b65000e21', '2b60a342-aeaf-4504-ac74-b0c03fd8b6e6', '83dcac5d-6cd7-4e61-a583-f17cef31f85c', '2fc132ec-a3a3-4ba8-83d5-79b2465f79f8'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:05 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:05 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:05 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:05 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:05 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:05 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" returned: 0 in 0.955s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:05 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c Jul 10 06:07:05 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:06 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info" returned: 0 in 1.001s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:06 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info is being set with open permissions: ugo+rw Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:06 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info Jul 10 06:07:06 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:06 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.047s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Deleted volume successfully. Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-60043747-6151-454d-8eca-a82052411967 tempest-VolumeAndVolumeTypeFromImageTest-1916154729 None] Lock "cinder-431ed8ac-04ff-42cc-a5c7-f9fc01403801-delete_volume" released by "delete_volume" :: held 4.203s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:06 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369.e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" returned: 0 in 1.005s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c" released by "_delete_snapshot" :: held 4.129s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-154d353f-1694-4fdd-ba93-fb0b3caaf369" released by "delete_snapshot" :: held 4.171s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:06 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Created reservations ['a6db2428-84b7-4241-affc-b49bda3ce61d', 'fbe3aadc-5e15-46b9-a883-370e996f66e7', '31dc8d51-1f5c-43bb-b837-f5c46cbeb5d9', '2412bce7-1e8f-465e-b7ac-e9f2c6cf3923'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Delete snapshot completed successfully. Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-14f9c432-c0e9-48d1-888c-d0a5403b3596 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-e9d2c67f-0aed-4d59-ac48-cfaa6f3e0b7c-delete_snapshot" released by "delete_snapshot" :: held 4.362s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:07 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.info" returned: 0 in 0.767s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.822s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1f9cb90a-12f7-4b1f-ac1f-8f669e219b3b tempest-ProjectReaderTests-1558325439 None] Create snapshot completed successfully Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-7f361a67-ad50-40b4-813a-4da049a2b365-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-7f361a67-ad50-40b4-813a-4da049a2b365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-97bc0354-de04-4417-80bb-c7366d3d7f89" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-97bc0354-de04-4417-80bb-c7366d3d7f89" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-7f361a67-ad50-40b4-813a-4da049a2b365" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-7f361a67-ad50-40b4-813a-4da049a2b365" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Deleting offline snapshot 7f361a67-ad50-40b4-813a-4da049a2b365 of volume 97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] snapshot_file for this snap is: volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[33778894-07fa-4c42-9c69-0c4429a1cb3a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-154d353f-1694-4fdd-ba93-fb0b3caaf369-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-154d353f-1694-4fdd-ba93-fb0b3caaf369-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-quobyte-154d353f-1694-4fdd-ba93-fb0b3caaf369" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:08 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 Jul 10 06:07:08 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-154d353f-1694-4fdd-ba93-fb0b3caaf369" acquired by "delete_volume" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf7c25-721a-4c47-89c0-fd77c4ddf57b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:08 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 Jul 10 06:07:08 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (b6d5772c-181b-4211-8c6e-325e00d2e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3d10b5-5e62-4769-a1bf-ead607b609f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3d10b5-5e62-4769-a1bf-ead607b609f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3154418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de05c2e2-0713-4ee2-8c7b-a4ff025aff42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:08Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d51172-383e-4b9b-94db-8054f1e9319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d51172-383e-4b9b-94db-8054f1e9319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a70ff2d-0cad-44e2-9741-3cee8f489eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a70ff2d-0cad-44e2-9741-3cee8f489eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de05c2e2-0713-4ee2-8c7b-a4ff025aff42', 'volume_name': 'volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94e3507-48a9-4da4-988f-407ff3dbec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94e3507-48a9-4da4-988f-407ff3dbec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6238cc7a-56fc-4566-ab16-ae61afed1d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:08 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume de05c2e2-0713-4ee2-8c7b-a4ff025aff42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42', 'volume_size': 1} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3154418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de05c2e2-0713-4ee2-8c7b-a4ff025aff42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:08Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating volume de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:08 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:08 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 1073741824 Jul 10 06:07:08 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:09 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365" returned: 0 in 1.178s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bc0354-de04-4417-80bb-c7366d3d7f89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b426b3a4-a781-4779-940a-4c4e4828ea5a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:09 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 Jul 10 06:07:09 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:09 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369" returned: 0 in 1.135s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:09 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369 Jul 10 06:07:09 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:09 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 1073741824" returned: 0 in 1.140s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:09 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 Jul 10 06:07:09 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:10 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-154d353f-1694-4fdd-ba93-fb0b3caaf369" returned: 0 in 0.767s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-154d353f-1694-4fdd-ba93-fb0b3caaf369" released by "delete_volume" :: held 2.003s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:10 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89" returned: 0 in 0.995s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:10 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 Jul 10 06:07:10 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Created reservations ['80616684-e497-4fb4-b5a0-d871eff34ad7', '57282f0e-4dc0-4b64-ac92-e15664e50390', '92ae73f0-6f0c-4116-bdde-d8e0c1d3c4ac', '8df6500f-4205-429c-a108-39f4009d4b92'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:10 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:10 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-6911d60d-43cc-4ede-b04e-ee7907fc0e2a-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Lock "cinder-6911d60d-43cc-4ede-b04e-ee7907fc0e2a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Acquiring lock "cinder-quobyte-6911d60d-43cc-4ede-b04e-ee7907fc0e2a" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-6911d60d-43cc-4ede-b04e-ee7907fc0e2a" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393bfb2-a079-419d-a3ba-e640b716cbd2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:10 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" returned: 0 in 1.068s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] <== create_volume: return (2261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6238cc7a-56fc-4566-ab16-ae61afed1d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483147c3-9ca7-4f6b-8590-e89b4ee47cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:10 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 (de05c2e2-0713-4ee2-8c7b-a4ff025aff42): created successfully Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483147c3-9ca7-4f6b-8590-e89b4ee47cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:10 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a Jul 10 06:07:10 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (b6d5772c-181b-4211-8c6e-325e00d2e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f0433f0d-e7d8-4421-aecf-7a4e6d0856e8 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created volume successfully. Jul 10 06:07:11 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.958s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Deleted volume successfully. Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2b3e3e9d-1e3d-4ccc-a0dd-c22e852cb4b1 tempest-CinderUnicodeTest-690887554 None] Lock "cinder-154d353f-1694-4fdd-ba93-fb0b3caaf369-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:11 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365" returned: 0 in 1.235s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:11 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365 Jul 10 06:07:11 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:11 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a" returned: 0 in 1.030s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:11 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a Jul 10 06:07:11 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating offline snapshot 4fc8a0d1-d225-4e9f-9e50-b86a691410e3 of volume de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4fc92-14f8-4aa1-bcec-96cfc80f05d3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:12 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 Jul 10 06:07:12 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (d8e41672-85d5-47cd-98be-98b6e6a421a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a895a226-a248-4fef-871c-b46b817f3daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a895a226-a248-4fef-871c-b46b817f3daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034324644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e732866-dd5a-477f-aa8f-3809d6a34e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:12Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c07bba-3324-43fb-9a86-fa65be8749c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c07bba-3324-43fb-9a86-fa65be8749c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:12 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcab3817-5033-4e96-9077-4c5330b36c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcab3817-5033-4e96-9077-4c5330b36c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e732866-dd5a-477f-aa8f-3809d6a34e59', 'volume_name': 'volume-1e732866-dd5a-477f-aa8f-3809d6a34e59', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745ec486-ba2e-4285-8663-3709bcd210f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745ec486-ba2e-4285-8663-3709bcd210f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa1cec0-44c9-4afb-81fc-3546084495f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:12 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume 1e732866-dd5a-477f-aa8f-3809d6a34e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e732866-dd5a-477f-aa8f-3809d6a34e59', 'volume_size': 1} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89.7f361a67-ad50-40b4-813a-4da049a2b365" returned: 0 in 0.952s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-7f361a67-ad50-40b4-813a-4da049a2b365" released by "_delete_snapshot" :: held 4.486s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-97bc0354-de04-4417-80bb-c7366d3d7f89" released by "delete_snapshot" :: held 4.516s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Created reservations ['9f9c7e33-357f-4852-894f-b9c81dc41ca0', '476d9dc0-394c-46f1-95fe-b234c8614da8', '0a0d0a54-a434-4064-b29f-6cce628cdeab', '3c76e006-caa9-433d-a22b-8985bad8ad95'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:12 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-6911d60d-43cc-4ede-b04e-ee7907fc0e2a" returned: 0 in 0.863s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Lock "cinder-quobyte-6911d60d-43cc-4ede-b04e-ee7907fc0e2a" released by "delete_volume" :: held 1.983s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Delete snapshot completed successfully. Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2798e6cd-260d-495a-87b8-72764cdcb237 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-7f361a67-ad50-40b4-813a-4da049a2b365-delete_snapshot" released by "delete_snapshot" :: held 4.701s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Created reservations ['937581a0-77eb-4cb3-b421-4872a4dfcf9b', '0d697ea6-1812-4d26-9040-76f3e99d240c', '85462e8e-816a-4453-a351-c481ad7836a8', '8c48740b-e077-4522-ac4e-82ba6e666432'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:12 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:12 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:12 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" returned: 0 in 0.892s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:12 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 1G Jul 10 06:07:12 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-97bc0354-de04-4417-80bb-c7366d3d7f89-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-97bc0354-de04-4417-80bb-c7366d3d7f89-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:13 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-97bc0354-de04-4417-80bb-c7366d3d7f89" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.708s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:13 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Deleted volume successfully. Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-97bc0354-de04-4417-80bb-c7366d3d7f89" acquired by "delete_volume" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8bbc43d0-c1dc-46d3-b53b-62214f3b3dba tempest-CinderUnicodeTest-690887554 None] Lock "cinder-6911d60d-43cc-4ede-b04e-ee7907fc0e2a-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[9598e403-2e67-452a-963b-9e58c6d53046]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:13 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 Jul 10 06:07:13 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:13 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 1G" returned: 0 in 0.989s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:13 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 Jul 10 06:07:13 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:14 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89" returned: 0 in 0.944s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:14 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89 Jul 10 06:07:14 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:14 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3" returned: 0 in 0.792s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:14 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 is being set with open permissions: ugo+rw Jul 10 06:07:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:14 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 Jul 10 06:07:14 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:15 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-97bc0354-de04-4417-80bb-c7366d3d7f89" returned: 0 in 0.759s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-97bc0354-de04-4417-80bb-c7366d3d7f89" released by "delete_volume" :: held 1.777s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Created reservations ['47b547d0-48bb-4bea-8418-cf8bff15f402', '18f07a50-8313-4991-8999-1daeb4eea163', 'a72bfaac-8cc2-4d76-b291-fdabddf6594b', 'e8c4054b-ebcf-4d8e-a711-295b0ae125ea'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:15 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3" returned: 0 in 0.690s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:15 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info Jul 10 06:07:15 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:15 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:15 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:16 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.816s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:16 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Deleted volume successfully. Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (e6a8b4dd-f8aa-43ea-91a9-fd07d97285df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c6f16a-79b3-4de0-89be-c12f580b7ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c6f16a-79b3-4de0-89be-c12f580b7ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585620097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f22803b-339c-488a-8f39-0aa700d1dc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:16Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:16 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5442899-c9b7-4e89-a4eb-ddd3792a1473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5442899-c9b7-4e89-a4eb-ddd3792a1473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6637d1d-7406-4d47-a77b-258cf35b884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6637d1d-7406-4d47-a77b-258cf35b884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f22803b-339c-488a-8f39-0aa700d1dc72', 'volume_name': 'volume-9f22803b-339c-488a-8f39-0aa700d1dc72', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3523cc-e99f-4778-9e13-0e87f366c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3523cc-e99f-4778-9e13-0e87f366c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938d1f00-28ed-4e98-b40e-0cd733d3be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:16 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Volume 9f22803b-339c-488a-8f39-0aa700d1dc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f22803b-339c-488a-8f39-0aa700d1dc72', 'volume_size': 1} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info" returned: 0 in 0.966s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:16 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info is being set with open permissions: ugo+rw Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c186e2a-cf7e-4f7c-b9b1-8b11cfab10d5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-97bc0354-de04-4417-80bb-c7366d3d7f89-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:16 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info Jul 10 06:07:16 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:17 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.info" returned: 0 in 0.697s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.163s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.628s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1034324644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e732866-dd5a-477f-aa8f-3809d6a34e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:12Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Creating volume 1e732866-dd5a-477f-aa8f-3809d6a34e59 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:17 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:17 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 1073741824 Jul 10 06:07:17 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:17 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2717ac8e-e6d9-4acf-a907-050499e5cc4e tempest-CreateVolumesFromSnapshotTest-881442131 None] Create snapshot completed successfully Jul 10 06:07:17 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 1073741824" returned: 0 in 0.837s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:17 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 Jul 10 06:07:17 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:18 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59" returned: 0 in 0.714s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585620097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f22803b-339c-488a-8f39-0aa700d1dc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:16Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Creating volume 9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:18 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:18 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 1073741824 Jul 10 06:07:18 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa1cec0-44c9-4afb-81fc-3546084495f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e732866-dd5a-477f-aa8f-3809d6a34e59', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8acb4d0-ab6f-44df-b757-65fe4f5da5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 (1e732866-dd5a-477f-aa8f-3809d6a34e59): created successfully Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8acb4d0-ab6f-44df-b757-65fe4f5da5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (d8e41672-85d5-47cd-98be-98b6e6a421a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:18 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-fccc0aa2-0821-408d-be32-01780ac3a427 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created volume successfully. Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (b6c02593-0d1d-4b3e-b425-f290b9e2dfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28307046-0443-4e86-a440-2fa9435a2b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28307046-0443-4e86-a440-2fa9435a2b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912250001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c58eb28-59c3-4fcb-91f8-0e65c24f61b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:19Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d56fea-75d2-49e0-8e50-a302206b7073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d56fea-75d2-49e0-8e50-a302206b7073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a91216-d624-4b59-a8e8-02c0fe713836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a91216-d624-4b59-a8e8-02c0fe713836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c58eb28-59c3-4fcb-91f8-0e65c24f61b3', 'volume_name': 'volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d962ad2c-e00d-4c38-b231-0fca9a0ec293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d962ad2c-e00d-4c38-b231-0fca9a0ec293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e143890-6d2e-4a0b-8f13-b0584ff0d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:18 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume 0c58eb28-59c3-4fcb-91f8-0e65c24f61b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3', 'volume_size': 1} Jul 10 06:07:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (1eb2fe2f-6b0d-4b54-82c0-0485c69e2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3531b3-b7f1-4948-9a16-2d848c5d42f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3531b3-b7f1-4948-9a16-2d848c5d42f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2032724451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39b0861-523c-43ff-9110-ca67033ea7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8904ac85-30ec-4bcc-86a6-b03d8067044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8904ac85-30ec-4bcc-86a6-b03d8067044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc99cb0-f67c-49c2-9054-e459c4b8abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc99cb0-f67c-49c2-9054-e459c4b8abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39b0861-523c-43ff-9110-ca67033ea7d3', 'volume_name': 'volume-a39b0861-523c-43ff-9110-ca67033ea7d3', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccf94bc-9108-48cb-ba1b-f563ea74ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccf94bc-9108-48cb-ba1b-f563ea74ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab117d07-9f25-4325-b643-b865f8e20bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume a39b0861-523c-43ff-9110-ca67033ea7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39b0861-523c-43ff-9110-ca67033ea7d3', 'volume_size': 1} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 1073741824" returned: 0 in 1.064s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:19 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 Jul 10 06:07:19 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (3561e896-9bc5-4ce8-b778-08b02a9abe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dff4ff-12db-4791-93e6-f7d874f0e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dff4ff-12db-4791-93e6-f7d874f0e771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2116620504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ac2519-f9fb-4802-88d3-d6460852d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5617a7-1baa-495b-9240-d28b75a6da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5617a7-1baa-495b-9240-d28b75a6da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e28b505-f4f1-41d2-9722-ffa824c8dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e28b505-f4f1-41d2-9722-ffa824c8dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ac2519-f9fb-4802-88d3-d6460852d137', 'volume_name': 'volume-05ac2519-f9fb-4802-88d3-d6460852d137', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ad5631-56d4-4eeb-b049-96e64f30ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ad5631-56d4-4eeb-b049-96e64f30ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d7d669-b520-4012-b3d7-80708773ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume 05ac2519-f9fb-4802-88d3-d6460852d137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ac2519-f9fb-4802-88d3-d6460852d137', 'volume_size': 1} Jul 10 06:07:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (1d67f144-a4d5-4504-afb9-980d557a97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abf50d2-3b19-495c-b69a-510b07a3063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abf50d2-3b19-495c-b69a-510b07a3063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474399733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb783928-0629-4e43-adaa-58490d414270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc6f03f-66b4-4ea1-aec1-96857186bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc6f03f-66b4-4ea1-aec1-96857186bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37583d2f-4990-42c3-96b8-f199e8107d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37583d2f-4990-42c3-96b8-f199e8107d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb783928-0629-4e43-adaa-58490d414270', 'volume_name': 'volume-cb783928-0629-4e43-adaa-58490d414270', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c978b34-dc12-4c4e-8860-bd66492b9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c978b34-dc12-4c4e-8860-bd66492b9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dbe9bb-b607-4c6b-9db6-9b58fa513dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume cb783928-0629-4e43-adaa-58490d414270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb783928-0629-4e43-adaa-58490d414270', 'volume_size': 1} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:20 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (f9bda6ee-d2df-47b0-8c64-7a60a0d16b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaffb66-ae06-40d8-8adf-005219e6bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72" returned: 0 in 0.830s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912250001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c58eb28-59c3-4fcb-91f8-0e65c24f61b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:19Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating volume 0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:20 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceaffb66-ae06-40d8-8adf-005219e6bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344450232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548527a3-98af-4e2d-87be-e7a4752a730b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a594753a-c644-4408-83c7-63104a29e5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a594753a-c644-4408-83c7-63104a29e5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 1073741824 Jul 10 06:07:20 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b193aa-de01-472e-b1b2-326411258b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b193aa-de01-472e-b1b2-326411258b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548527a3-98af-4e2d-87be-e7a4752a730b', 'volume_name': 'volume-548527a3-98af-4e2d-87be-e7a4752a730b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8231d07-7d21-4e89-b8fb-11ebd55f9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8231d07-7d21-4e89-b8fb-11ebd55f9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3f5695-7bbd-44ca-94d6-584903783813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume 548527a3-98af-4e2d-87be-e7a4752a730b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548527a3-98af-4e2d-87be-e7a4752a730b', 'volume_size': 1} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938d1f00-28ed-4e98-b40e-0cd733d3be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f22803b-339c-488a-8f39-0aa700d1dc72', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b334e6e-0857-43fd-82d9-5ea1dc6ad4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Volume volume-9f22803b-339c-488a-8f39-0aa700d1dc72 (9f22803b-339c-488a-8f39-0aa700d1dc72): created successfully Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b334e6e-0857-43fd-82d9-5ea1dc6ad4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (e6a8b4dd-f8aa-43ea-91a9-fd07d97285df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (6269a803-47cc-4b3f-8185-afee7e20a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb9c8c6-de7d-4fd9-a4b4-8add3d631cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-27035808-888c-4216-87e0-d0796848cbef tempest-ProjectReaderTests-1558325439 None] Created volume successfully. Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb9c8c6-de7d-4fd9-a4b4-8add3d631cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-581577973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d42de4-4468-4adc-aad5-c7201e364e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:21Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac48f4cf-0ae1-475f-85c8-c3873c02ed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac48f4cf-0ae1-475f-85c8-c3873c02ed33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38c42ad-6ab9-4bb0-b211-2d576ab46952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38c42ad-6ab9-4bb0-b211-2d576ab46952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d42de4-4468-4adc-aad5-c7201e364e42', 'volume_name': 'volume-b9d42de4-4468-4adc-aad5-c7201e364e42', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbc0262-73f7-4013-b908-434b4fe99ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbc0262-73f7-4013-b908-434b4fe99ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f524ecf-6a67-4619-91f3-2bfa8dd5ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:20 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume b9d42de4-4468-4adc-aad5-c7201e364e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d42de4-4468-4adc-aad5-c7201e364e42', 'volume_size': 1} Jul 10 06:07:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (bff324b7-8d33-437b-8320-d4990bf414e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff10839-5b7a-4167-9da7-d43b25d42715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff10839-5b7a-4167-9da7-d43b25d42715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026182278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d8e892-82cb-4489-81ea-de9b90170f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:21Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecf5fec-82a0-4b17-97c3-f2fba1b0982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecf5fec-82a0-4b17-97c3-f2fba1b0982b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26236fc-d9bc-40e8-8694-b3d49488ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26236fc-d9bc-40e8-8694-b3d49488ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d8e892-82cb-4489-81ea-de9b90170f03', 'volume_name': 'volume-36d8e892-82cb-4489-81ea-de9b90170f03', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb53190-8d32-41e9-a87d-897b746559fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb53190-8d32-41e9-a87d-897b746559fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170039ed-7516-4e8c-8037-57396158daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume 36d8e892-82cb-4489-81ea-de9b90170f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d8e892-82cb-4489-81ea-de9b90170f03', 'volume_size': 1} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (e4772185-bdd8-4287-87fe-5d38958a34e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96895cc-179b-4400-9912-6e820fe8f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96895cc-179b-4400-9912-6e820fe8f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1680979485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99c99c6-253d-47af-ab34-cfb7e736fb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:22Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15b396e-0538-49f7-8ad6-64ce01ff4783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15b396e-0538-49f7-8ad6-64ce01ff4783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a203692-14d5-4f7d-9f52-d050ec5409bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a203692-14d5-4f7d-9f52-d050ec5409bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99c99c6-253d-47af-ab34-cfb7e736fb38', 'volume_name': 'volume-d99c99c6-253d-47af-ab34-cfb7e736fb38', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81950a29-6b6a-4edc-955e-daf54b55060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81950a29-6b6a-4edc-955e-daf54b55060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07455c2-d8e0-4940-b5fc-cd001fbbb4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume d99c99c6-253d-47af-ab34-cfb7e736fb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99c99c6-253d-47af-ab34-cfb7e736fb38', 'volume_size': 1} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:21 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 1073741824" returned: 0 in 1.251s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:21 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 Jul 10 06:07:21 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (a81f16cb-14ec-4306-b5e5-5365c26badac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a8cec7-0365-4988-a36a-3a0ddcd7963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a8cec7-0365-4988-a36a-3a0ddcd7963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445732006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7bab3-badb-466f-ba67-e9bb6472dd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:22Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f673bb0-bb47-4e4e-9a77-48f162d3970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f673bb0-bb47-4e4e-9a77-48f162d3970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75066270-cfb8-41cf-a880-d4875c3d36d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75066270-cfb8-41cf-a880-d4875c3d36d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b7bab3-badb-466f-ba67-e9bb6472dd40', 'volume_name': 'volume-36b7bab3-badb-466f-ba67-e9bb6472dd40', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66bbd82-897a-4343-93b6-1a654286cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66bbd82-897a-4343-93b6-1a654286cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eecb771-fe38-45ae-9b42-a4438b08a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume 36b7bab3-badb-466f-ba67-e9bb6472dd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b7bab3-badb-466f-ba67-e9bb6472dd40', 'volume_size': 1} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (ceaa5e19-330b-446f-a911-6387d665ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc126f5-aec0-4fc3-b222-2ad8f9170755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc126f5-aec0-4fc3-b222-2ad8f9170755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1730865466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f2f811-88c0-4c9a-9a45-d75819a20b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:22Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc5f284-8a34-4726-b5af-165a498ac850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc5f284-8a34-4726-b5af-165a498ac850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb231dca-42d4-4dcf-8974-84040b886e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb231dca-42d4-4dcf-8974-84040b886e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f2f811-88c0-4c9a-9a45-d75819a20b74', 'volume_name': 'volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48d907d-5e11-4cbb-985d-2ebfca9ef809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48d907d-5e11-4cbb-985d-2ebfca9ef809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dbfadb7-98aa-4244-af43-ccbcba237a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume c4f2f811-88c0-4c9a-9a45-d75819a20b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74', 'volume_size': 1} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:22 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2032724451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39b0861-523c-43ff-9110-ca67033ea7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating volume a39b0861-523c-43ff-9110-ca67033ea7d3 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:22 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:22 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 1073741824 Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e143890-6d2e-4a0b-8f13-b0584ff0d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e7a5fa-9804-4347-959c-bc8a9b2662a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:22 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 (0c58eb28-59c3-4fcb-91f8-0e65c24f61b3): created successfully Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e7a5fa-9804-4347-959c-bc8a9b2662a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:22 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (b6c02593-0d1d-4b3e-b425-f290b9e2dfd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:22 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5afc7fb2-a68d-43fb-903c-139be024d7b5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created volume successfully. Jul 10 06:07:23 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 1073741824" returned: 0 in 0.946s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:23 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 Jul 10 06:07:23 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:24 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.463s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2116620504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ac2519-f9fb-4802-88d3-d6460852d137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating volume 05ac2519-f9fb-4802-88d3-d6460852d137 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:24 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab117d07-9f25-4325-b643-b865f8e20bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39b0861-523c-43ff-9110-ca67033ea7d3', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:24 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 1073741824 Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67226cb1-7427-4af4-b71e-52c4592ba3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:24 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume volume-a39b0861-523c-43ff-9110-ca67033ea7d3 (a39b0861-523c-43ff-9110-ca67033ea7d3): created successfully Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67226cb1-7427-4af4-b71e-52c4592ba3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (1eb2fe2f-6b0d-4b54-82c0-0485c69e2b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-bd1d5203-7d88-41f6-97da-c2f3e68003fb tempest-CreateVolumesFromSnapshotTest-881442131 None] Created volume successfully. Jul 10 06:07:25 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 1073741824" returned: 0 in 0.905s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:25 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 Jul 10 06:07:25 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:26 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137" returned: 0 in 0.685s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.665s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474399733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb783928-0629-4e43-adaa-58490d414270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating volume cb783928-0629-4e43-adaa-58490d414270 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:26 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:26 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 1073741824 Jul 10 06:07:26 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d7d669-b520-4012-b3d7-80708773ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ac2519-f9fb-4802-88d3-d6460852d137', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5124eb9-19b8-4ae0-bfe6-47fa12bc0a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume volume-05ac2519-f9fb-4802-88d3-d6460852d137 (05ac2519-f9fb-4802-88d3-d6460852d137): created successfully Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5124eb9-19b8-4ae0-bfe6-47fa12bc0a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (3561e896-9bc5-4ce8-b778-08b02a9abe44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-84db6a95-af33-4da8-b4f7-65eac8ccc6a3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created volume successfully. Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Flow 'volume_create_manager' (06d75658-7e65-42fe-9e39-7e83ca99a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1b52a9-7e8e-4d35-ab51-4a3ea3b95993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1b52a9-7e8e-4d35-ab51-4a3ea3b95993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969927292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb91ec7-89a2-4161-8101-c37111d4acac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb91a5d466634084bf20810af8f149da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:27Z,use_quota=True,user_id='54e8750c02c340f6a056359af4eb56a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b541bc-9602-467b-b635-e2720f753a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b541bc-9602-467b-b635-e2720f753a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478426e9-3b89-4b43-a94a-1acb242be3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478426e9-3b89-4b43-a94a-1acb242be3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb91ec7-89a2-4161-8101-c37111d4acac', 'volume_name': 'volume-deb91ec7-89a2-4161-8101-c37111d4acac', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d2397c-f20a-4bcf-ba1e-5d45c22c5ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d2397c-f20a-4bcf-ba1e-5d45c22c5ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f422b2e-24f5-4230-814c-130876936163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:26 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Volume deb91ec7-89a2-4161-8101-c37111d4acac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb91ec7-89a2-4161-8101-c37111d4acac', 'volume_size': 1} Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:26 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 1073741824" returned: 0 in 0.907s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:27 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 Jul 10 06:07:27 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:27 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270" returned: 0 in 0.693s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.997s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344450232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548527a3-98af-4e2d-87be-e7a4752a730b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:20Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Creating volume 548527a3-98af-4e2d-87be-e7a4752a730b {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:27 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dbe9bb-b607-4c6b-9db6-9b58fa513dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb783928-0629-4e43-adaa-58490d414270', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:27 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b 1073741824 Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2962805-7df0-496f-8465-894c14384e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:27 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:27 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume volume-cb783928-0629-4e43-adaa-58490d414270 (cb783928-0629-4e43-adaa-58490d414270): created successfully Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2962805-7df0-496f-8465-894c14384e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:27 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (1d67f144-a4d5-4504-afb9-980d557a97eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:27 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5e0aa93b-ad76-4fc1-a5e0-b3e0c0fb1ad5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created volume successfully. Jul 10 06:07:28 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b 1073741824" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:28 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b Jul 10 06:07:28 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:28 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:28 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:29 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b" returned: 0 in 0.650s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.315s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-581577973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d42de4-4468-4adc-aad5-c7201e364e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57491b6ff2ec47f994a66978399dcfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:21Z,use_quota=True,user_id='669249d0e99147ea87cfca626c797a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Creating volume b9d42de4-4468-4adc-aad5-c7201e364e42 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:29 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3f5695-7bbd-44ca-94d6-584903783813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548527a3-98af-4e2d-87be-e7a4752a730b', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:29 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 1073741824 Jul 10 06:07:29 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7626b9c5-24f7-4f8f-84a4-92f1e45a9432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:29 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume volume-548527a3-98af-4e2d-87be-e7a4752a730b (548527a3-98af-4e2d-87be-e7a4752a730b): created successfully Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7626b9c5-24f7-4f8f-84a4-92f1e45a9432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (f9bda6ee-d2df-47b0-8c64-7a60a0d16b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b2b74b89-7ca0-4657-9bc3-1c260f2cc3bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created volume successfully. Jul 10 06:07:29 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:07:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:07:30 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 1073741824" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:30 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 Jul 10 06:07:30 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:30 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42" returned: 0 in 0.663s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.590s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026182278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d8e892-82cb-4489-81ea-de9b90170f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:21Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Creating volume 36d8e892-82cb-4489-81ea-de9b90170f03 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:30 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:30 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 1073741824 Jul 10 06:07:30 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f524ecf-6a67-4619-91f3-2bfa8dd5ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d42de4-4468-4adc-aad5-c7201e364e42', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b8284c-bebd-4d32-99b8-17d46dda3e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:30 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Volume volume-b9d42de4-4468-4adc-aad5-c7201e364e42 (b9d42de4-4468-4adc-aad5-c7201e364e42): created successfully Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b8284c-bebd-4d32-99b8-17d46dda3e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:30 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Flow 'volume_create_manager' (6269a803-47cc-4b3f-8185-afee7e20a28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-251ec149-e548-487b-9ef4-084ef33114ed tempest-CreateVolumesFromSnapshotTest-881442131 None] Created volume successfully. Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-b9d42de4-4468-4adc-aad5-c7201e364e42-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-b9d42de4-4468-4adc-aad5-c7201e364e42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-b9d42de4-4468-4adc-aad5-c7201e364e42" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-b9d42de4-4468-4adc-aad5-c7201e364e42" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f3bf3e-00fa-4117-becb-df0970b6c58b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:31 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 1073741824" returned: 0 in 0.861s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:31 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 Jul 10 06:07:31 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:31 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 Jul 10 06:07:31 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:32 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03" returned: 0 in 0.632s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.497s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1680979485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99c99c6-253d-47af-ab34-cfb7e736fb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:22Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Creating volume d99c99c6-253d-47af-ab34-cfb7e736fb38 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:32 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170039ed-7516-4e8c-8037-57396158daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d8e892-82cb-4489-81ea-de9b90170f03', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:32 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 1073741824 Jul 10 06:07:32 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85c6607-9d14-42e7-801d-4ee96fa30c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:32 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume volume-36d8e892-82cb-4489-81ea-de9b90170f03 (36d8e892-82cb-4489-81ea-de9b90170f03): created successfully Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85c6607-9d14-42e7-801d-4ee96fa30c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (bff324b7-8d33-437b-8320-d4990bf414e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e127c1c8-798b-4e66-8a9c-44a7a10a66ee tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created volume successfully. Jul 10 06:07:32 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:32 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42 Jul 10 06:07:32 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:33 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b9d42de4-4468-4adc-aad5-c7201e364e42" returned: 0 in 0.678s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-b9d42de4-4468-4adc-aad5-c7201e364e42" released by "delete_volume" :: held 1.536s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['20d1c2d8-4124-476e-8ca6-d37fd59751d0', '5d540127-2d9c-4df7-81e5-086832c164c0', 'e3b808d7-2cf2-439e-8f4c-2dc828ec5f32', 'f6d55236-79f1-47c3-9a19-70ddc9689190'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:33 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 1073741824" returned: 0 in 0.917s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:33 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:33 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:33 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 Jul 10 06:07:33 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-cb783928-0629-4e43-adaa-58490d414270-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-cb783928-0629-4e43-adaa-58490d414270-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-cb783928-0629-4e43-adaa-58490d414270" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-cb783928-0629-4e43-adaa-58490d414270" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3357297f-a33f-431e-89ab-6860208d0080]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:33 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.721s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:33 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleted volume successfully. Jul 10 06:07:34 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 Jul 10 06:07:34 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-95c52774-f320-432e-ace1-408767d9a6e3 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-b9d42de4-4468-4adc-aad5-c7201e364e42-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:34 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.703s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445732006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7bab3-badb-466f-ba67-e9bb6472dd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:22Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Creating volume 36b7bab3-badb-466f-ba67-e9bb6472dd40 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:34 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07455c2-d8e0-4940-b5fc-cd001fbbb4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99c99c6-253d-47af-ab34-cfb7e736fb38', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4400f4a8-3eb8-4235-8952-142d92331028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:34 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 1073741824 Jul 10 06:07:34 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:34 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 (d99c99c6-253d-47af-ab34-cfb7e736fb38): created successfully Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4400f4a8-3eb8-4235-8952-142d92331028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (e4772185-bdd8-4287-87fe-5d38958a34e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-a51922dc-6071-4b71-ae8e-adbb9b5781aa tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created volume successfully. Jul 10 06:07:34 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270" returned: 0 in 0.813s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:34 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270 Jul 10 06:07:34 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:34 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 1073741824" returned: 0 in 0.871s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:35 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 Jul 10 06:07:35 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:35 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-cb783928-0629-4e43-adaa-58490d414270" returned: 0 in 0.673s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-cb783928-0629-4e43-adaa-58490d414270" released by "delete_volume" :: held 1.537s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['dcb2892c-1590-49dc-9fc0-6bfc01297320', '2ba83c3d-f177-4bbb-8d52-57a126bba4d8', 'f5fc6db6-9e5d-462b-82f0-47c373d7cfba', 'd7e1facd-065e-4c08-9b2a-bc26bbcb744f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:35 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:35 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:35 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40" returned: 0 in 0.671s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.205s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eecb771-fe38-45ae-9b42-a4438b08a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b7bab3-badb-466f-ba67-e9bb6472dd40', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6180c55d-8b19-4252-91e3-9d4e36cc176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Creating offline snapshot 8941345b-b125-4edf-bb11-8f7c3d4518cb of volume 9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:07:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 (36b7bab3-badb-466f-ba67-e9bb6472dd40): created successfully Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6180c55d-8b19-4252-91e3-9d4e36cc176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (a81f16cb-14ec-4306-b5e5-5365c26badac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98fc219-a8a3-43ac-b9dc-e272dc919697]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e707c50d-ab32-4ec9-a460-200f92cc39f9 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created volume successfully. Jul 10 06:07:35 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 Jul 10 06:07:35 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-05ac2519-f9fb-4802-88d3-d6460852d137-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-05ac2519-f9fb-4802-88d3-d6460852d137-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-05ac2519-f9fb-4802-88d3-d6460852d137" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-05ac2519-f9fb-4802-88d3-d6460852d137" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29ce31-2f41-46b2-b083-443c8e3048e8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:36 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.724s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:36 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleted volume successfully. Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f7d12be1-0e4a-426f-9288-23de493f90fe tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-cb783928-0629-4e43-adaa-58490d414270-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:36 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 Jul 10 06:07:36 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:36 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72" returned: 0 in 0.897s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:36 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb 1G Jul 10 06:07:36 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:37 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137" returned: 0 in 0.828s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:37 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137 Jul 10 06:07:37 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:37 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb 1G" returned: 0 in 0.876s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f22803b-339c-488a-8f39-0aa700d1dc72 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:37 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f22803b-339c-488a-8f39-0aa700d1dc72 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb Jul 10 06:07:37 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:37 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-05ac2519-f9fb-4802-88d3-d6460852d137" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-05ac2519-f9fb-4802-88d3-d6460852d137" released by "delete_volume" :: held 1.541s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=181,cinder:SELECT=120,cinder:INSERT=47,cinder:DELETE=18 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['826a50b9-f28d-46b5-b7bd-49294070bfb3', 'af1e4b16-b765-437b-b9f6-28dc9e23c997', '0510faf3-eb64-4f73-bbbd-fd995cdb8a78', '862ff010-6ce6-4d5b-9752-8d7b3433a1f6'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:37 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:37 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-a39b0861-523c-43ff-9110-ca67033ea7d3-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:38 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f22803b-339c-488a-8f39-0aa700d1dc72 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb" returned: 0 in 0.786s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:38 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb is being set with open permissions: ugo+rw Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-a39b0861-523c-43ff-9110-ca67033ea7d3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=141,cinder:UPDATE=166,cinder:DELETE=17,cinder:INSERT=43 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:07:38 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb Jul 10 06:07:38 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-a39b0861-523c-43ff-9110-ca67033ea7d3" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-a39b0861-523c-43ff-9110-ca67033ea7d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d7142-7fd8-485b-96ff-341960bd4568]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:38 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 Jul 10 06:07:38 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:38 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:38 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleted volume successfully. Jul 10 06:07:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-12703378-ea58-4066-9864-866e8322ee36 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-05ac2519-f9fb-4802-88d3-d6460852d137-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:39 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb" returned: 0 in 0.678s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:39 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info Jul 10 06:07:39 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:39 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3" returned: 0 in 0.818s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:39 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3 Jul 10 06:07:39 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:39 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info" returned: 0 in 0.693s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:39 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info is being set with open permissions: ugo+rw Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:39 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info Jul 10 06:07:39 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:39 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-a39b0861-523c-43ff-9110-ca67033ea7d3" returned: 0 in 0.629s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-a39b0861-523c-43ff-9110-ca67033ea7d3" released by "delete_volume" :: held 1.499s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:39 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['02dd1345-81d6-4b24-8ae1-0a8f30b92f21', '57b23d2b-6777-44e3-a1b7-a863fae5a026', '5a8d9f84-63e3-4ec7-ad23-495c703874fc', '676b24c0-5d29-487f-b6d2-b0d63d0f8763'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:40 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:40 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:40 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.info" returned: 0 in 0.642s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.696s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.790s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1730865466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f2f811-88c0-4c9a-9a45-d75819a20b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c990144cd4467b9cb188bb44ca07a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:22Z,use_quota=True,user_id='4b31255146ce45608d893990091553bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Creating volume c4f2f811-88c0-4c9a-9a45-d75819a20b74 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:40 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:40 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 1073741824 Jul 10 06:07:40 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-756e508f-d6c4-4cca-9215-846d34376337 tempest-ProjectReaderTests-1558325439 None] Create snapshot completed successfully Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5301fad-7fd1-4e9e-bedf-10fd19625f2a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:40 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.720s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:40 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleted volume successfully. Jul 10 06:07:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c9a4a0bc-956c-4464-9eac-721bbe5b1d1b tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-a39b0861-523c-43ff-9110-ca67033ea7d3-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:40 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 Jul 10 06:07:40 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-8941345b-b125-4edf-bb11-8f7c3d4518cb-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-8941345b-b125-4edf-bb11-8f7c3d4518cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-9f22803b-339c-488a-8f39-0aa700d1dc72" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-9f22803b-339c-488a-8f39-0aa700d1dc72" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-8941345b-b125-4edf-bb11-8f7c3d4518cb" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-8941345b-b125-4edf-bb11-8f7c3d4518cb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Deleting offline snapshot 8941345b-b125-4edf-bb11-8f7c3d4518cb of volume 9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] snapshot_file for this snap is: volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac522f1-c42c-4b71-a209-2557e4bae6fe]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:41 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb Jul 10 06:07:41 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:41 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 1073741824" returned: 0 in 0.927s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:41 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 Jul 10 06:07:41 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:41 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3" returned: 0 in 0.821s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:41 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3 Jul 10 06:07:41 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:41 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb" returned: 0 in 0.795s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f22803b-339c-488a-8f39-0aa700d1dc72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1cb60b-7d7a-4818-b65e-86312badf7ce]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:42 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74" returned: 0 in 0.700s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.094s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969927292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb91ec7-89a2-4161-8101-c37111d4acac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb91a5d466634084bf20810af8f149da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:27Z,use_quota=True,user_id='54e8750c02c340f6a056359af4eb56a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Creating volume deb91ec7-89a2-4161-8101-c37111d4acac {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:42 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:42 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac 1073741824 Jul 10 06:07:42 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dbfadb7-98aa-4244-af43-ccbcba237a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30334f72-d438-4cfa-93d2-622fd0667998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:42 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Volume volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 (c4f2f811-88c0-4c9a-9a45-d75819a20b74): created successfully Jul 10 06:07:42 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 Jul 10 06:07:42 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30334f72-d438-4cfa-93d2-622fd0667998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Flow 'volume_create_manager' (ceaa5e19-330b-446f-a911-6387d665ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:42 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-572fa504-6397-4be9-8327-700b8bd32e19 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created volume successfully. Jul 10 06:07:42 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3" returned: 0 in 0.721s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3" released by "delete_volume" :: held 1.600s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['1bbef32c-75d9-4a45-99fa-348e2f0db693', '23f1b372-48fc-4349-b069-96ded89e8cd7', '2924cae7-f3d7-4c0e-b503-4786728a4ab5', '5c6a5a88-81e5-4960-847c-f9058d3416e2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:42 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:42 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-4fc8a0d1-d225-4e9f-9e50-b86a691410e3-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-4fc8a0d1-d225-4e9f-9e50-b86a691410e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-4fc8a0d1-d225-4e9f-9e50-b86a691410e3" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-4fc8a0d1-d225-4e9f-9e50-b86a691410e3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleting offline snapshot 4fc8a0d1-d225-4e9f-9e50-b86a691410e3 of volume de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:07:42 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] snapshot_file for this snap is: volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72" returned: 0 in 0.925s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bf73e-614d-4974-a4f6-9f0b11c37dee]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:42 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb Jul 10 06:07:42 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-c4f2f811-88c0-4c9a-9a45-d75819a20b74-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-c4f2f811-88c0-4c9a-9a45-d75819a20b74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-quobyte-c4f2f811-88c0-4c9a-9a45-d75819a20b74" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:43 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 Jul 10 06:07:43 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-c4f2f811-88c0-4c9a-9a45-d75819a20b74" acquired by "delete_volume" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[87193103-34dc-43ca-92c5-04b21ed3cad5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:43 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.890s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:43 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleted volume successfully. Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac 1073741824" returned: 0 in 1.223s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-8510fbd4-aedf-4502-bac9-359a2f0b219a tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-0c58eb28-59c3-4fcb-91f8-0e65c24f61b3-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:43 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 Jul 10 06:07:43 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:43 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac Jul 10 06:07:43 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:43 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb" returned: 0 in 0.782s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:43 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb Jul 10 06:07:43 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:44 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3" returned: 0 in 1.048s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e935ccc1-b640-47c6-a827-65b105154b76]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:44 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac" returned: 0 in 0.732s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f422b2e-24f5-4230-814c-130876936163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb91ec7-89a2-4161-8101-c37111d4acac', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:44 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4283adc5-dd53-4d2d-bda0-77d2d6670a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74" returned: 0 in 0.907s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:44 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Volume volume-deb91ec7-89a2-4161-8101-c37111d4acac (deb91ec7-89a2-4161-8101-c37111d4acac): created successfully Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4283adc5-dd53-4d2d-bda0-77d2d6670a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Flow 'volume_create_manager' (06d75658-7e65-42fe-9e39-7e83ca99a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:44 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74 Jul 10 06:07:44 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-22459c8f-f827-4e62-87b6-799779f19b74 tempest-ProjectReaderTests-206454464 None] Created volume successfully. Jul 10 06:07:44 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 Jul 10 06:07:44 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:44 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72.8941345b-b125-4edf-bb11-8f7c3d4518cb" returned: 0 in 0.739s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-8941345b-b125-4edf-bb11-8f7c3d4518cb" released by "_delete_snapshot" :: held 3.337s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-9f22803b-339c-488a-8f39-0aa700d1dc72" released by "delete_snapshot" :: held 3.363s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Created reservations ['47774af5-bb84-4f5e-9142-219ed0c57d03', 'c7d4764f-d1b7-4f63-9aa9-708b082dfbaa', 'ffd6c725-de2a-4277-bc23-6731f4cd5390', '18a5a52b-505e-4424-92d4-2cfce97478f9'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Delete snapshot completed successfully. Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1384fe46-2c5a-430d-aa43-984525b57292 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-8941345b-b125-4edf-bb11-8f7c3d4518cb-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:44 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-c4f2f811-88c0-4c9a-9a45-d75819a20b74" returned: 0 in 0.748s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-c4f2f811-88c0-4c9a-9a45-d75819a20b74" released by "delete_volume" :: held 1.695s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:44 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" returned: 0 in 0.838s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:44 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 Jul 10 06:07:44 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:44 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created reservations ['1b99ed59-2c44-4d3a-b8c2-a9faed419c07', '93dd7a97-610b-4988-bfc1-06dc32f26ae2', '266dfda9-21ac-4ab0-9387-892b5ad1b9b4', '89888d0b-750a-40f4-8c6b-daa3440f352e'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:45 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:45 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Acquiring lock "cinder-deb91ec7-89a2-4161-8101-c37111d4acac-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Lock "cinder-deb91ec7-89a2-4161-8101-c37111d4acac-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-36b7bab3-badb-466f-ba67-e9bb6472dd40-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-9f22803b-339c-488a-8f39-0aa700d1dc72-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-36b7bab3-badb-466f-ba67-e9bb6472dd40-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-9f22803b-339c-488a-8f39-0aa700d1dc72-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Acquiring lock "cinder-quobyte-deb91ec7-89a2-4161-8101-c37111d4acac" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-quobyte-36b7bab3-badb-466f-ba67-e9bb6472dd40" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Lock "cinder-quobyte-deb91ec7-89a2-4161-8101-c37111d4acac" acquired by "delete_volume" :: waited 0.065s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-9f22803b-339c-488a-8f39-0aa700d1dc72" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[35379c04-024b-438b-a091-65875f7e040a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-36b7bab3-badb-466f-ba67-e9bb6472dd40" acquired by "delete_volume" :: waited 0.054s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-9f22803b-339c-488a-8f39-0aa700d1dc72" acquired by "delete_volume" :: waited 0.061s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc9192d-b1dd-4b83-b587-029dfa31374a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ece9b5-2d27-40c0-84b2-be1145fdc304]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:45 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac Jul 10 06:07:45 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:45 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:45 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Deleted volume successfully. Jul 10 06:07:45 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3" returned: 0 in 0.952s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c73d3cd8-b533-4280-b51f-d1f2aac136e1 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-c4f2f811-88c0-4c9a-9a45-d75819a20b74-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:45 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3 Jul 10 06:07:45 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 Jul 10 06:07:45 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:45 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:45 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 Jul 10 06:07:45 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:46 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac" returned: 0 in 0.961s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:46 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40" returned: 0 in 0.911s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:46 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:46 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac Jul 10 06:07:46 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:46 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72" returned: 0 in 0.908s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42.4fc8a0d1-d225-4e9f-9e50-b86a691410e3" returned: 0 in 0.820s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:46 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40 Jul 10 06:07:46 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:46 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72 Jul 10 06:07:46 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-4fc8a0d1-d225-4e9f-9e50-b86a691410e3" released by "_delete_snapshot" :: held 3.840s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" released by "delete_snapshot" :: held 3.874s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['0fe9509c-f451-4437-ab35-c78c92de867d', '729bfbf3-e637-420b-a8c3-4f03fbfe1fdb', '46d71dbf-d41f-476e-b08d-ed31509cd598', '6c052c9b-6ea3-4659-a842-64aa40561d4f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:46 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Delete snapshot completed successfully. Jul 10 06:07:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-edfff2c5-9b6f-4ae7-9e90-e08a70ed5bc9 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-4fc8a0d1-d225-4e9f-9e50-b86a691410e3-delete_snapshot" released by "delete_snapshot" :: held 4.062s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-de05c2e2-0713-4ee2-8c7b-a4ff025aff42-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-de05c2e2-0713-4ee2-8c7b-a4ff025aff42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "cinder-quobyte-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" acquired by "delete_volume" :: waited 0.025s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff581b44-15f4-4c12-836d-3d9bda60bcdf]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:47 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36b7bab3-badb-466f-ba67-e9bb6472dd40" returned: 0 in 0.723s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-36b7bab3-badb-466f-ba67-e9bb6472dd40" released by "delete_volume" :: held 1.714s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:47 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 Jul 10 06:07:47 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:47 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created reservations ['4807c2a0-34ba-4bad-b475-7cba9a3c18a9', 'd82c6a8f-8e3b-42af-8695-3aa6ea032d46', 'de3dd328-d52c-4a98-9e1e-ba1988d19f74', 'e017ec6b-93b8-4fa8-b21c-caa90a93dafd'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-deb91ec7-89a2-4161-8101-c37111d4acac" returned: 0 in 0.826s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Lock "cinder-quobyte-deb91ec7-89a2-4161-8101-c37111d4acac" released by "delete_volume" :: held 1.843s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:47 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-9f22803b-339c-488a-8f39-0aa700d1dc72" returned: 0 in 0.831s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-9f22803b-339c-488a-8f39-0aa700d1dc72" released by "delete_volume" :: held 1.823s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:47 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:47 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Created reservations ['bd2836f3-6f6a-4ec1-a613-5bd6212ec712', '7d00419f-9f4e-4198-8b40-2bf76c129f2b', 'e7d6e144-f3aa-437b-8bcc-f0a59c06653f', '45ef814b-3a33-4925-a914-3388f08e7f68'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Created reservations ['9efe568b-5534-4b9d-88ca-4649327c5eb0', '5eb7e431-da08-45c0-98d3-6788a4f012c5', '6ffd6b4d-1438-40c5-8abf-fd1b62a11167', 'e6572231-bc89-4635-b2a8-bd4751046cbc'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-d99c99c6-253d-47af-ab34-cfb7e736fb38-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-d99c99c6-253d-47af-ab34-cfb7e736fb38-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:47 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:47 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-quobyte-d99c99c6-253d-47af-ab34-cfb7e736fb38" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-d99c99c6-253d-47af-ab34-cfb7e736fb38" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[de51cbb3-c70f-4b05-9d31-4dc0cb6b8746]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:48 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:48 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:48 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 Jul 10 06:07:48 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:48 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" returned: 0 in 1.155s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:48 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42 Jul 10 06:07:48 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:48 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.149s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Deleted volume successfully. Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5f2f85af-3d4d-4fa2-ac61-71eabd5a2d2d tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-36b7bab3-badb-466f-ba67-e9bb6472dd40-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (aef66587-299b-4966-a658-d11ed8546525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68401109-2a42-4c30-be42-5733f67ea31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68401109-2a42-4c30-be42-5733f67ea31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259056000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e9b326-02ce-4bda-9605-e4d0a032637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:49Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a1d7b3-466d-4006-ba00-55f711f40db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:48 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a1d7b3-466d-4006-ba00-55f711f40db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed10d20f-adb6-484b-b2b7-0d4b1b872117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed10d20f-adb6-484b-b2b7-0d4b1b872117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e9b326-02ce-4bda-9605-e4d0a032637d', 'volume_name': 'volume-24e9b326-02ce-4bda-9605-e4d0a032637d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc75f63-c1c9-475f-ad44-729ee6ad06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc75f63-c1c9-475f-ad44-729ee6ad06d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df61b277-29f3-454d-abbb-9e27d6021bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Volume 24e9b326-02ce-4bda-9605-e4d0a032637d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e9b326-02ce-4bda-9605-e4d0a032637d', 'volume_size': 1} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259056000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e9b326-02ce-4bda-9605-e4d0a032637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:49Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Creating volume 24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:49 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:49 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.220s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Deleted volume successfully. Jul 10 06:07:49 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d 1073741824 Jul 10 06:07:49 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-66e2c955-5c4c-4fcd-96b1-f1539730ef12 tempest-ProjectReaderTests-206454464 None] Lock "cinder-deb91ec7-89a2-4161-8101-c37111d4acac-delete_volume" released by "delete_volume" :: held 3.803s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:49 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.217s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Deleted volume successfully. Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-adc5ec29-d551-423f-bdf3-478417401894 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-9f22803b-339c-488a-8f39-0aa700d1dc72-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" returned: 0 in 1.065s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:49 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-quobyte-de05c2e2-0713-4ee2-8c7b-a4ff025aff42" released by "delete_volume" :: held 2.306s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:49 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38" returned: 0 in 1.560s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:49 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38 Jul 10 06:07:49 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Flow 'volume_create_manager' (b78769e9-3493-4586-9734-d48f89210c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5db18e0-6c66-4ac7-9dd0-364663d2b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Created reservations ['ecf90997-ac39-458d-8f5d-0d14b255fd26', '027535ee-ebe2-4c2b-84c8-932f8e24de19', 'e55d068e-f27e-4823-b93a-aa2ea4210127', 'cb9d7c3c-b450-41e1-9b86-43143452cbbe'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5db18e0-6c66-4ac7-9dd0-364663d2b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007431353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cc977f-2ea6-4439-b141-5226c001ee6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb91a5d466634084bf20810af8f149da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:50Z,use_quota=True,user_id='54e8750c02c340f6a056359af4eb56a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701f3fa7-383e-4aaa-84c4-c5977ffac949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701f3fa7-383e-4aaa-84c4-c5977ffac949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8d908-1887-4066-9c3c-64b127e380a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e8d908-1887-4066-9c3c-64b127e380a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26cc977f-2ea6-4439-b141-5226c001ee6c', 'volume_name': 'volume-26cc977f-2ea6-4439-b141-5226c001ee6c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f869ed5a-f723-4e83-acc1-09692e628d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f869ed5a-f723-4e83-acc1-09692e628d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5812a396-85da-4162-a2e6-889f88dcb286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:49 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Volume 26cc977f-2ea6-4439-b141-5226c001ee6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26cc977f-2ea6-4439-b141-5226c001ee6c', 'volume_size': 1} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:49 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:49 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:50 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d 1073741824" returned: 0 in 1.091s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:50 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d Jul 10 06:07:50 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:50 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-d99c99c6-253d-47af-ab34-cfb7e736fb38" returned: 0 in 0.797s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-d99c99c6-253d-47af-ab34-cfb7e736fb38" released by "delete_volume" :: held 2.424s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created reservations ['3dc5d52d-7d4b-419b-a926-60c9be46b0f8', 'a7abadbd-bb58-41a4-9366-f20f44d60afd', 'aa04130c-de31-4d6c-9979-1218313a4ac3', 'f5f9b8e3-54a9-4ece-b991-b430d397fdd4'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:50 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:50 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:50 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.798s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:50 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Deleted volume successfully. Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-dcc6c782-8d14-4c36-9fc3-2437ae453fa5 tempest-CreateVolumesFromSnapshotTest-881442131 None] Lock "cinder-de05c2e2-0713-4ee2-8c7b-a4ff025aff42-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:50 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d" returned: 0 in 0.711s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007431353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cc977f-2ea6-4439-b141-5226c001ee6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb91a5d466634084bf20810af8f149da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:50Z,use_quota=True,user_id='54e8750c02c340f6a056359af4eb56a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Creating volume 26cc977f-2ea6-4439-b141-5226c001ee6c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:07:50 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:50 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c 1073741824 Jul 10 06:07:50 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df61b277-29f3-454d-abbb-9e27d6021bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e9b326-02ce-4bda-9605-e4d0a032637d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f27aef1-da95-429e-b0aa-77d40ccf1bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:50 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Volume volume-24e9b326-02ce-4bda-9605-e4d0a032637d (24e9b326-02ce-4bda-9605-e4d0a032637d): created successfully Jul 10 06:07:50 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f27aef1-da95-429e-b0aa-77d40ccf1bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (aef66587-299b-4966-a658-d11ed8546525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f4dc988a-f0a9-46e4-ad44-46bda5245416 tempest-ProjectReaderTests-1558325439 None] Created volume successfully. Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-36d8e892-82cb-4489-81ea-de9b90170f03-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-36d8e892-82cb-4489-81ea-de9b90170f03-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-quobyte-36d8e892-82cb-4489-81ea-de9b90170f03" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-36d8e892-82cb-4489-81ea-de9b90170f03" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fafafe7-1d22-46db-ab6f-f73dab4337b8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:51 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.814s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Deleted volume successfully. Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-6352332f-08f3-4545-b42d-84e4930c28bb tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-d99c99c6-253d-47af-ab34-cfb7e736fb38-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:51 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 Jul 10 06:07:51 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:51 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c 1073741824" returned: 0 in 1.055s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:52 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c Jul 10 06:07:52 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:52 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03" returned: 0 in 1.012s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:52 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03 Jul 10 06:07:52 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:52 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c" returned: 0 in 0.880s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.644s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5812a396-85da-4162-a2e6-889f88dcb286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26cc977f-2ea6-4439-b141-5226c001ee6c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3a3a1a-ee72-410a-a723-1ceb0b6aa7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Creating offline snapshot 05449903-8afc-4580-9b72-2068bc44d0a5 of volume 24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:07:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Volume volume-26cc977f-2ea6-4439-b141-5226c001ee6c (26cc977f-2ea6-4439-b141-5226c001ee6c): created successfully Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3a3a1a-ee72-410a-a723-1ceb0b6aa7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Flow 'volume_create_manager' (b78769e9-3493-4586-9734-d48f89210c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[441b65b1-0752-4551-af84-71df17b3e3b7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-679c5c4e-e6d6-4946-b808-7f493fc54305 tempest-ProjectReaderTests-206454464 None] Created volume successfully. Jul 10 06:07:53 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-36d8e892-82cb-4489-81ea-de9b90170f03" returned: 0 in 0.731s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-36d8e892-82cb-4489-81ea-de9b90170f03" released by "delete_volume" :: held 1.814s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:53 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d Jul 10 06:07:53 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created reservations ['f05d31ec-d56c-4f41-a76e-6a23783d89a5', '8028127e-205a-44e7-a266-a3a19f3d332f', '2d8796f7-2514-4ef3-a662-c6a2c59fbfcd', 'd9b5db9e-ffe1-4146-bf24-4b634229cef2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:53 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:53 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-548527a3-98af-4e2d-87be-e7a4752a730b-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-548527a3-98af-4e2d-87be-e7a4752a730b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-quobyte-548527a3-98af-4e2d-87be-e7a4752a730b" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-548527a3-98af-4e2d-87be-e7a4752a730b" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e73d56-05f6-4cb6-a9f1-b5a29cc4994f]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:53 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b Jul 10 06:07:53 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:53 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d" returned: 0 in 0.958s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:53 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 1G Jul 10 06:07:53 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:54 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Deleted volume successfully. Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Acquiring lock "cinder-26cc977f-2ea6-4439-b141-5226c001ee6c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0ab95249-7fa8-4d23-9c5a-f85e2c654a45 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-36d8e892-82cb-4489-81ea-de9b90170f03-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Lock "cinder-26cc977f-2ea6-4439-b141-5226c001ee6c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Acquiring lock "cinder-quobyte-26cc977f-2ea6-4439-b141-5226c001ee6c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Lock "cinder-quobyte-26cc977f-2ea6-4439-b141-5226c001ee6c" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb88473-b700-4a72-86bd-91309462e927]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:54 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c Jul 10 06:07:54 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:54 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b" returned: 0 in 0.967s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:54 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b Jul 10 06:07:54 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:54 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 1G" returned: 0 in 1.009s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e9b326-02ce-4bda-9605-e4d0a032637d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:54 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e9b326-02ce-4bda-9605-e4d0a032637d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 Jul 10 06:07:54 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:55 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c" returned: 0 in 0.864s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:55 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c Jul 10 06:07:55 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:55 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-548527a3-98af-4e2d-87be-e7a4752a730b" returned: 0 in 0.797s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-548527a3-98af-4e2d-87be-e7a4752a730b" released by "delete_volume" :: held 1.824s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created reservations ['9c946ea2-3d10-4e88-9d62-a68baf29fa05', '0a9e33f2-512d-4594-a53e-eb4249b5e2ff', '0fc0f723-a417-45e6-9ea2-3860b8c3ba79', '89be8865-9d20-4eef-b215-9ef0f36d7af4'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:55 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:55 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-1e732866-dd5a-477f-aa8f-3809d6a34e59-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-1e732866-dd5a-477f-aa8f-3809d6a34e59-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "cinder-quobyte-1e732866-dd5a-477f-aa8f-3809d6a34e59" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-1e732866-dd5a-477f-aa8f-3809d6a34e59" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:55 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e9b326-02ce-4bda-9605-e4d0a032637d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5" returned: 0 in 1.010s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:55 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 is being set with open permissions: ugo+rw Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:55 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-26cc977f-2ea6-4439-b141-5226c001ee6c" returned: 0 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d09efb-84f3-4669-8496-be760a5acd6b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:56 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 Jul 10 06:07:56 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Lock "cinder-quobyte-26cc977f-2ea6-4439-b141-5226c001ee6c" released by "delete_volume" :: held 1.795s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Created reservations ['5a94d342-4ec1-49f6-bf31-a1de34faeddc', '26f9814a-cf98-457a-a674-3cbaa5c12fce', 'ae1a64a0-22b2-4f45-ae5d-0571a25de66a', '4f372170-e89d-406c-b8f2-61fe8c095351'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:56 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 Jul 10 06:07:56 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:56 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:56 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:56 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.006s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Deleted volume successfully. Jul 10 06:07:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-07ce6c8b-7044-4a5d-983d-c1564c0b2d0b tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-548527a3-98af-4e2d-87be-e7a4752a730b-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:57 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59" returned: 0 in 1.026s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:57 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5" returned: 0 in 1.085s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:57 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59 Jul 10 06:07:57 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:57 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info Jul 10 06:07:57 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:57 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.105s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:57 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Deleted volume successfully. Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-2ea1605b-349d-487e-9667-1b7be482967d tempest-ProjectReaderTests-206454464 None] Lock "cinder-26cc977f-2ea6-4439-b141-5226c001ee6c-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Flow 'volume_create_manager' (211b5333-d15f-47af-b97a-d6417002f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c70538-1439-4d32-a2f2-e64b69a37f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c70538-1439-4d32-a2f2-e64b69a37f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8788c9d-357f-4059-a8a0-ce719d6a1f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0690c3f9937740329da2774120342ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:57Z,use_quota=True,user_id='1eac560701684add98f3747d3ac92d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d462cb77-d3b3-4dde-923b-eb2b67d51e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d462cb77-d3b3-4dde-923b-eb2b67d51e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31bff98-224c-4c06-b763-e36ada23f8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.image.glance [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Creating Keystone auth plugin from conf {{(pid=87449) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:07:57 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-1e732866-dd5a-477f-aa8f-3809d6a34e59" returned: 0 in 0.887s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-quobyte-1e732866-dd5a-477f-aa8f-3809d6a34e59" released by "delete_volume" :: held 1.987s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:57 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Created reservations ['34679f8d-1d58-4a25-ae71-8230ff27107a', 'aedf55bf-4846-41c2-ad7f-46494bb971e8', 'c0375256-76d0-464a-9807-084b2e2957da', '6e49c4dd-cd48-46a9-bd08-584587cda743'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:07:58 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info" returned: 0 in 0.937s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:58 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info is being set with open permissions: ugo+rw Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:58 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info Jul 10 06:07:58 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31bff98-224c-4c06-b763-e36ada23f8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8788c9d-357f-4059-a8a0-ce719d6a1f5d', 'volume_name': 'volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d', 'volume_size': 1, 'image_id': '8f97006f-e186-4335-a843-b149de4fd40b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f97006f-e186-4335-a843-b149de4fd40b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbdb6a0a70a21ad7ad9566c80e9ff5eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0690c3f9937740329da2774120342ec7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55ab1b1f59fdf1fb9ae7dc94e97125a90340aeade3f5d0534f1f21ef33ec670480097f0c669eb6f1f060d99f0c12c31baf3e8cbd68fe5407244182312665d706', 'id': '8f97006f-e186-4335-a843-b149de4fd40b', 'created_at': datetime.datetime(2026, 7, 10, 4, 7, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 7, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f97006f-e186-4335-a843-b149de4fd40b/file', 'properties': {}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ba1074-1df7-45d6-b565-49784593747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ba1074-1df7-45d6-b565-49784593747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8b5cf9-3f07-4996-be2b-0910fd214090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:07:58 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Volume f8788c9d-357f-4059-a8a0-ce719d6a1f5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d', 'volume_size': 1, 'image_id': '8f97006f-e186-4335-a843-b149de4fd40b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f97006f-e186-4335-a843-b149de4fd40b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbdb6a0a70a21ad7ad9566c80e9ff5eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0690c3f9937740329da2774120342ec7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55ab1b1f59fdf1fb9ae7dc94e97125a90340aeade3f5d0534f1f21ef33ec670480097f0c669eb6f1f060d99f0c12c31baf3e8cbd68fe5407244182312665d706', 'id': '8f97006f-e186-4335-a843-b149de4fd40b', 'created_at': datetime.datetime(2026, 7, 10, 4, 7, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 7, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f97006f-e186-4335-a843-b149de4fd40b/file', 'properties': {}}, 'image_service': } Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Trying to clone f8788c9d-357f-4059-a8a0-ce719d6a1f5d from image 8f97006f-e186-4335-a843-b149de4fd40b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f97006f-e186-4335-a843-b149de4fd40b', 'metadata': {}}]). {{(pid=87449) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:58 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:07:58 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 10 06:07:58 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c93e3d-2eb2-40ff-8c8e-0044ae3ea941]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:58 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD Jul 10 06:07:58 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:59 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.info" returned: 0 in 1.002s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:59 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.150s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.935s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:07:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Deleted volume successfully. Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d02855b8-a4ad-455c-b611-f0efbd88aa69 tempest-CreateVolumesFromSourceVolumeTest-303062526 None] Lock "cinder-1e732866-dd5a-477f-aa8f-3809d6a34e59-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:07:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-045380ba-aa01-4f32-8451-d6b04b66e704 tempest-ProjectReaderTests-1558325439 None] Create snapshot completed successfully Jul 10 06:07:59 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD" returned: 0 in 0.998s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:07:59 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD Jul 10 06:07:59 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-05449903-8afc-4580-9b72-2068bc44d0a5-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Lock "cinder-05449903-8afc-4580-9b72-2068bc44d0a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-24e9b326-02ce-4bda-9605-e4d0a032637d" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-24e9b326-02ce-4bda-9605-e4d0a032637d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-05449903-8afc-4580-9b72-2068bc44d0a5" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-05449903-8afc-4580-9b72-2068bc44d0a5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Deleting offline snapshot 05449903-8afc-4580-9b72-2068bc44d0a5 of volume 24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] snapshot_file for this snap is: volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e497277-23e1-4fae-9345-fd97d13b0473]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:07:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:00 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 Jul 10 06:08:00 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:00 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD" returned: 1 in 0.856s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Temporary image 8f97006f-e186-4335-a843-b149de4fd40b is fetched for user 1eac560701684add98f3747d3ac92d94. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df30f7c-0a84-43fa-ad81-2d62e4e086f6]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:00 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD Jul 10 06:08:00 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:00 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5" returned: 0 in 1.005s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e9b326-02ce-4bda-9605-e4d0a032637d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b5ff9d-a63a-4071-bb97-16904f73288a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:01 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d Jul 10 06:08:01 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:01 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD" returned: 0 in 0.913s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:01 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD Jul 10 06:08:01 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:01 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d" returned: 0 in 0.997s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:01 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 Jul 10 06:08:01 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:02 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD" returned: 1 in 0.857s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8788c9d-357f-4059-a8a0-ce719d6a1f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0690c3f9937740329da2774120342ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:07:57Z,use_quota=True,user_id='1eac560701684add98f3747d3ac92d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Creating volume f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:02 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:02 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d 1073741824 Jul 10 06:08:02 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Flow 'volume_create_manager' (ad3820ad-de84-41e7-b4ae-18b6a1798ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f6592-3ef2-4294-a6d0-4209743e28ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6f6592-3ef2-4294-a6d0-4209743e28ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-611751824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da7eb4c-a525-406e-9352-a049df9ad127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c56f2518341ce9391003810129e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:02Z,use_quota=True,user_id='df370cde6de24d20aa12a974e9bae30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbeeb5d-867b-4d63-9685-672ef1cbebc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbeeb5d-867b-4d63-9685-672ef1cbebc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db46a7ce-6703-47f7-ac9f-86efc9045cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db46a7ce-6703-47f7-ac9f-86efc9045cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da7eb4c-a525-406e-9352-a049df9ad127', 'volume_name': 'volume-2da7eb4c-a525-406e-9352-a049df9ad127', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05b4c7a-10a6-417c-8fd4-063ff4594711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05b4c7a-10a6-417c-8fd4-063ff4594711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645459b2-2bf9-4acd-b2e5-f75d8bdc2748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Volume 2da7eb4c-a525-406e-9352-a049df9ad127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da7eb4c-a525-406e-9352-a049df9ad127', 'volume_size': 1} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (0fc3754c-6357-46e2-9981-56cb9b2db5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5941e940-6c5b-475e-85eb-37cdd1dc7cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5941e940-6c5b-475e-85eb-37cdd1dc7cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637698686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff124a77-e638-4399-b9b3-ed2350964665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:02Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd130912-9177-4e36-a94a-d380d9c0637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd130912-9177-4e36-a94a-d380d9c0637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621f5ff1-2529-4b97-baf1-d019298bb542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621f5ff1-2529-4b97-baf1-d019298bb542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff124a77-e638-4399-b9b3-ed2350964665', 'volume_name': 'volume-ff124a77-e638-4399-b9b3-ed2350964665', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f1272a-ebe9-40f9-be6a-f2476f278698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f1272a-ebe9-40f9-be6a-f2476f278698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ac7878-729f-40f3-9c43-d6d5209f3f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:02 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Volume ff124a77-e638-4399-b9b3-ed2350964665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff124a77-e638-4399-b9b3-ed2350964665', 'volume_size': 1} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:02 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5" returned: 0 in 0.913s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:02 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5 Jul 10 06:08:02 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:03 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d 1073741824" returned: 0 in 0.924s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:03 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:03 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:03 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d.05449903-8afc-4580-9b72-2068bc44d0a5" returned: 0 in 0.640s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-05449903-8afc-4580-9b72-2068bc44d0a5" released by "_delete_snapshot" :: held 3.666s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-24e9b326-02ce-4bda-9605-e4d0a032637d" released by "delete_snapshot" :: held 3.707s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Created reservations ['ac8b40a9-c8d8-41df-af0f-3e3d47f9bd2d', '699fbcdf-2ca7-4c75-acf5-1f64a6c29e88', '55740f45-3130-4049-843d-77ace8ba9012', '9d48618d-b5e6-42a5-b297-6b7fdb25ea8b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:03 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Delete snapshot completed successfully. Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-760ba8d3-1649-4e84-91b4-7086aebe86fa tempest-ProjectReaderTests-1558325439 None] Lock "cinder-05449903-8afc-4580-9b72-2068bc44d0a5-delete_snapshot" released by "delete_snapshot" :: held 3.876s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:03 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-611751824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da7eb4c-a525-406e-9352-a049df9ad127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c56f2518341ce9391003810129e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:02Z,use_quota=True,user_id='df370cde6de24d20aa12a974e9bae30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Creating volume 2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:03 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:03 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 1073741824 Jul 10 06:08:03 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Attempting download of 8f97006f-e186-4335-a843-b149de4fd40b ((None, [{'url': 'file:///opt/stack/data/glance/images/8f97006f-e186-4335-a843-b149de4fd40b', 'metadata': {}}])) to volume f8788c9d-357f-4059-a8a0-ce719d6a1f5d. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e39a406-8dab-477c-8818-403c48bcc8ed]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:03 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm Jul 10 06:08:03 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-24e9b326-02ce-4bda-9605-e4d0a032637d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-24e9b326-02ce-4bda-9605-e4d0a032637d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-24e9b326-02ce-4bda-9605-e4d0a032637d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-24e9b326-02ce-4bda-9605-e4d0a032637d" acquired by "delete_volume" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c054f21f-210b-4b8b-ba75-6f90a9f299eb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:04 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d Jul 10 06:08:04 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:04 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 1073741824" returned: 0 in 0.870s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:04 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm" returned: 0 in 0.822s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:04 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:04 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:04 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm Jul 10 06:08:04 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:04 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d" returned: 0 in 0.876s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:05 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d Jul 10 06:08:05 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:05 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.706s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637698686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff124a77-e638-4399-b9b3-ed2350964665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:02Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Creating volume ff124a77-e638-4399-b9b3-ed2350964665 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:05 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645459b2-2bf9-4acd-b2e5-f75d8bdc2748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da7eb4c-a525-406e-9352-a049df9ad127', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bab7f1-3bb1-486e-9fd2-0013e5e56083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:05 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 1073741824 Jul 10 06:08:05 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Volume volume-2da7eb4c-a525-406e-9352-a049df9ad127 (2da7eb4c-a525-406e-9352-a049df9ad127): created successfully Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bab7f1-3bb1-486e-9fd2-0013e5e56083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Flow 'volume_create_manager' (ad3820ad-de84-41e7-b4ae-18b6a1798ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-cd8f1b3e-cba4-48fe-a0e4-f89028f1b5ee tempest-VolumeDependencyTests-813392224 None] Created volume successfully. Jul 10 06:08:05 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm" returned: 1 in 0.835s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f97006f-e186-4335-a843-b149de4fd40b_rlliigtm' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db5656-258c-4b7e-9590-bc719f7f498d]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:05 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD Jul 10 06:08:05 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:05 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-24e9b326-02ce-4bda-9605-e4d0a032637d" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-24e9b326-02ce-4bda-9605-e4d0a032637d" released by "delete_volume" :: held 1.699s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Created reservations ['2623c594-7381-454f-9e6e-5e5c86de400e', '2fa962ba-618f-4b34-b234-8effbbe53213', '0fc950fb-44dd-4d70-a19b-ed0123c3becb', 'b6b3442e-1670-4f19-aba1-a116e6565ca0'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:05 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:05 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:06 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD" returned: 0 in 0.913s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:06 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 1073741824" returned: 0 in 1.181s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:06 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD Jul 10 06:08:06 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:06 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 Jul 10 06:08:06 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:06 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.864s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:06 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Deleted volume successfully. Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-668b2742-2b0e-42ab-9c3c-67d1bdcf4114 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-24e9b326-02ce-4bda-9605-e4d0a032637d-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (65caadd3-f682-4916-a1e7-3ae7d6152b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fa6bf1-82e4-44ca-8112-d6f00fc21cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fa6bf1-82e4-44ca-8112-d6f00fc21cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494643162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:07Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:06 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08457497-5d41-4833-8a32-9cb6eb70635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08457497-5d41-4833-8a32-9cb6eb70635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ea78d4-865c-4e20-8112-7fe45aa881da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ea78d4-865c-4e20-8112-7fe45aa881da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f', 'volume_name': 'volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b08cc84-56c6-4625-93e4-3cb40d0f967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b08cc84-56c6-4625-93e4-3cb40d0f967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f69c9df-558a-403d-ade1-7bd21a7e969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:07 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Volume 7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f', 'volume_size': 1} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:07 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD" returned: 1 in 0.951s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] 8f97006f-e186-4335-a843-b149de4fd40b was raw, converting to raw {{(pid=87449) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:07 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665" returned: 0 in 0.771s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.869s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:07 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:07 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Creating offline snapshot 8c8f28ac-f879-4477-b4b4-686f0569cfc9 of volume 2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ac7878-729f-40f3-9c43-d6d5209f3f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff124a77-e638-4399-b9b3-ed2350964665', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1627cdbb-52eb-46cd-aec5-e33d997e5859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0c890a-36f7-42f5-879c-23119859feac]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:07 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Volume volume-ff124a77-e638-4399-b9b3-ed2350964665 (ff124a77-e638-4399-b9b3-ed2350964665): created successfully Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1627cdbb-52eb-46cd-aec5-e33d997e5859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (0fc3754c-6357-46e2-9981-56cb9b2db5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-8b2f6a5b-b0ef-48ed-b3ca-8fe881dd3616 tempest-ProjectReaderTests-557016192 None] Created volume successfully. Jul 10 06:08:07 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:07 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:08 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:08 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.809s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 0 in 0.886s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f97006f-e186-4335-a843-b149de4fd40b_2_3j9iq3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:08:08 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:08 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 1G Jul 10 06:08:08 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:08 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d 1G Jul 10 06:08:08 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-ff124a77-e638-4399-b9b3-ed2350964665-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Lock "cinder-ff124a77-e638-4399-b9b3-ed2350964665-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-quobyte-ff124a77-e638-4399-b9b3-ed2350964665" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-ff124a77-e638-4399-b9b3-ed2350964665" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[05feb831-4691-4ee5-b911-77581a521d05]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:08 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 Jul 10 06:08:08 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:09 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d 1G" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa8879-37f5-4be8-9a78-a3af7fe3cdea]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:09 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 1G" returned: 0 in 0.914s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da7eb4c-a525-406e-9352-a049df9ad127 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:09 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da7eb4c-a525-406e-9352-a049df9ad127 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 Jul 10 06:08:09 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:09 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:09 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:09 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:09 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665 Jul 10 06:08:09 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:09 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 0 in 0.801s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:09 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da7eb4c-a525-406e-9352-a049df9ad127 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9" returned: 0 in 0.744s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:09 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 is being set with open permissions: ugo+rw Jul 10 06:08:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:09 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 Jul 10 06:08:09 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:10 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:10 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:10 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-ff124a77-e638-4399-b9b3-ed2350964665" returned: 0 in 0.726s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-ff124a77-e638-4399-b9b3-ed2350964665" released by "delete_volume" :: held 1.580s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Created reservations ['f2d45151-057f-4cdb-a6cf-565d0bc69ccb', '056391cd-9b93-4e12-8eae-486e41021902', 'fa026fd9-62f2-4a90-93c2-03240f87e7af', '77d98bbe-b8a3-4275-87c7-760ea3b72118'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:10 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:10 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:10 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9" returned: 0 in 0.694s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:10 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info Jul 10 06:08:10 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:10 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 1 in 0.836s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Downloaded image 8f97006f-e186-4335-a843-b149de4fd40b ((None, [{'url': 'file:///opt/stack/data/glance/images/8f97006f-e186-4335-a843-b149de4fd40b', 'metadata': {}}])) to volume f8788c9d-357f-4059-a8a0-ce719d6a1f5d successfully. {{(pid=87449) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Temporary image 8f97006f-e186-4335-a843-b149de4fd40b for user 1eac560701684add98f3747d3ac92d94 is deleted. {{(pid=87449) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.volume_utils [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Marking volume f8788c9d-357f-4059-a8a0-ce719d6a1f5d as bootable. {{(pid=87449) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Copying metadata from image 8f97006f-e186-4335-a843-b149de4fd40b to f8788c9d-357f-4059-a8a0-ce719d6a1f5d. {{(pid=87449) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Creating volume glance metadata for volume f8788c9d-357f-4059-a8a0-ce719d6a1f5d backed by image 8f97006f-e186-4335-a843-b149de4fd40b with: {'image_id': '8f97006f-e186-4335-a843-b149de4fd40b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cbdb6a0a70a21ad7ad9566c80e9ff5eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87449) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8b5cf9-3f07-4996-be2b-0910fd214090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d', 'volume_size': 1, 'image_id': '8f97006f-e186-4335-a843-b149de4fd40b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f97006f-e186-4335-a843-b149de4fd40b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbdb6a0a70a21ad7ad9566c80e9ff5eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0690c3f9937740329da2774120342ec7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55ab1b1f59fdf1fb9ae7dc94e97125a90340aeade3f5d0534f1f21ef33ec670480097f0c669eb6f1f060d99f0c12c31baf3e8cbd68fe5407244182312665d706', 'id': '8f97006f-e186-4335-a843-b149de4fd40b', 'created_at': datetime.datetime(2026, 7, 10, 4, 7, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 7, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f97006f-e186-4335-a843-b149de4fd40b/file', 'properties': {}}, 'image_service': }' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d74ca3-59fd-4991-97ab-2f6ef6701c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:10 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Volume volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d (f8788c9d-357f-4059-a8a0-ce719d6a1f5d): created successfully Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d74ca3-59fd-4991-97ab-2f6ef6701c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:10 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Flow 'volume_create_manager' (211b5333-d15f-47af-b97a-d6417002f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0d30372f-09fd-4c23-a8cd-0ff35046391a tempest-VolumeImageDependencyTests-1714230091 None] Created volume successfully. Jul 10 06:08:11 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.778s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:11 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Deleted volume successfully. Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5c56b348-bfa2-4c9b-ae0c-51b69993fa70 tempest-ProjectReaderTests-557016192 None] Lock "cinder-ff124a77-e638-4399-b9b3-ed2350964665-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (769608f6-e6d1-46e1-8db7-223992a26ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73de850f-a225-47ff-a977-28e947311b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73de850f-a225-47ff-a977-28e947311b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389114509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d54473f-affe-4687-af16-fa4d514d741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:11Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0702216-e7a5-443e-bcf9-3462fb61fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0702216-e7a5-443e-bcf9-3462fb61fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c0a7b4-6c7c-4f7c-8222-aeb77bd8ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c0a7b4-6c7c-4f7c-8222-aeb77bd8ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d54473f-affe-4687-af16-fa4d514d741e', 'volume_name': 'volume-7d54473f-affe-4687-af16-fa4d514d741e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:11 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b08a5d8-42f7-4073-8c8e-ffcffd48a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b08a5d8-42f7-4073-8c8e-ffcffd48a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f87e3b-8e19-417b-b676-0131a0e22390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:11 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Volume 7d54473f-affe-4687-af16-fa4d514d741e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d54473f-affe-4687-af16-fa4d514d741e', 'volume_size': 1} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info" returned: 0 in 0.779s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:11 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info is being set with open permissions: ugo+rw Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:11 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info Jul 10 06:08:11 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Acquiring lock "cinder-f8788c9d-357f-4059-a8a0-ce719d6a1f5d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Lock "cinder-f8788c9d-357f-4059-a8a0-ce719d6a1f5d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Acquiring lock "cinder-quobyte-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Lock "cinder-quobyte-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e37bdb-7a2f-4d2e-9164-109d9b75d460]: (4, 'raw') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:11 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:11 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:12 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.info" returned: 0 in 0.678s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.738s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.148s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494643162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:07Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Creating volume 7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:12 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:12 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f 1073741824 Jul 10 06:08:12 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-99b354d7-d3d1-4eb1-b8ec-12f864a8343b tempest-VolumeDependencyTests-813392224 None] Create snapshot completed successfully Jul 10 06:08:12 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:12 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:12 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:13 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f 1073741824" returned: 0 in 0.961s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:13 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f Jul 10 06:08:13 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:13 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Flow 'volume_create_manager' (77bd78f9-288a-4c40-ab7d-4530fbed340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2540eb88-cd6a-49d3-846d-1da45dc0c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 1 in 0.918s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d' failed. Not Retrying. {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2540eb88-cd6a-49d3-846d-1da45dc0c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-958964038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553dc71a-a640-438d-8df3-a0eca56efdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c56f2518341ce9391003810129e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c8f28ac-f879-4477-b4b4-686f0569cfc9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:13Z,use_quota=True,user_id='df370cde6de24d20aa12a974e9bae30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:13 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d Jul 10 06:08:13 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498d1aed-2e30-40e2-adda-240e87d5b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498d1aed-2e30-40e2-adda-240e87d5b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837da0c9-f58e-4c8a-a2af-06d6be888e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837da0c9-f58e-4c8a-a2af-06d6be888e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '553dc71a-a640-438d-8df3-a0eca56efdc8', 'volume_name': 'volume-553dc71a-a640-438d-8df3-a0eca56efdc8', 'volume_size': 1, 'snapshot_id': '8c8f28ac-f879-4477-b4b4-686f0569cfc9'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5d3281-5d0f-41c4-9046-b73272eab166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5d3281-5d0f-41c4-9046-b73272eab166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3041f85d-7d7b-4b8a-a07b-eb7f2afc6881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:13 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Volume 553dc71a-a640-438d-8df3-a0eca56efdc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-553dc71a-a640-438d-8df3-a0eca56efdc8', 'volume_size': 1, 'snapshot_id': '8c8f28ac-f879-4477-b4b4-686f0569cfc9'} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:13 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" returned: 0 in 0.674s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.424s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389114509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d54473f-affe-4687-af16-fa4d514d741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:11Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Creating volume 7d54473f-affe-4687-af16-fa4d514d741e {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:13 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:13 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e 1073741824 Jul 10 06:08:13 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f69c9df-558a-403d-ade1-7bd21a7e969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a81d0e1-a188-494f-9cff-d7d2cbb82c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:13 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Volume volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f (7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f): created successfully Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a81d0e1-a188-494f-9cff-d7d2cbb82c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:13 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (65caadd3-f682-4916-a1e7-3ae7d6152b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1da09fe9-d220-4d6c-b8fe-f252abd43eca tempest-ProjectReaderTests-1558325439 None] Created volume successfully. Jul 10 06:08:14 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" returned: 0 in 0.684s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Lock "cinder-quobyte-f8788c9d-357f-4059-a8a0-ce719d6a1f5d" released by "delete_volume" :: held 2.472s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Created reservations ['03f5493c-516a-4145-8309-2c2bbc00d91b', '154d62f8-513b-4246-bb44-5d41a2fb4082', '3bf46856-ad5a-43b7-8566-ef21fb994464', 'f00cd6e1-b7e4-4233-ad2c-2c750b934225'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:14 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:14 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:14 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e 1073741824" returned: 0 in 0.921s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:14 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e Jul 10 06:08:14 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:15 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.757s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Deleted volume successfully. Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-30b7dd9c-5a66-4a89-9e5b-5aade106c1d8 tempest-VolumeImageDependencyTests-1714230091 None] Lock "cinder-f8788c9d-357f-4059-a8a0-ce719d6a1f5d-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:15 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e" returned: 0 in 0.692s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.939s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-quobyte-8c8f28ac-f879-4477-b4b4-686f0569cfc9-553dc71a-a640-438d-8df3-a0eca56efdc8" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f87e3b-8e19-417b-b676-0131a0e22390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d54473f-affe-4687-af16-fa4d514d741e', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01113211-00d6-4ca2-b694-180f6c7d6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-8c8f28ac-f879-4477-b4b4-686f0569cfc9-553dc71a-a640-438d-8df3-a0eca56efdc8" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Creating volume 553dc71a-a640-438d-8df3-a0eca56efdc8 from snapshot 8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-quobyte-553dc71a-a640-438d-8df3-a0eca56efdc8" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:15 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Volume volume-7d54473f-affe-4687-af16-fa4d514d741e (7d54473f-affe-4687-af16-fa4d514d741e): created successfully Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01113211-00d6-4ca2-b694-180f6c7d6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (769608f6-e6d1-46e1-8db7-223992a26ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-553dc71a-a640-438d-8df3-a0eca56efdc8" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] snapshot: 8c8f28ac-f879-4477-b4b4-686f0569cfc9, volume: 553dc71a-a640-438d-8df3-a0eca56efdc8, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:15 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7fdf0c50-858d-4b43-8074-2e45d9acedb7 tempest-ProjectReaderTests-557016192 None] Created volume successfully. Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8683398d-50c8-4901-a08f-cddfe6fcb3f6]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:15 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 Jul 10 06:08:15 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:16 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9" returned: 0 in 0.845s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da7eb4c-a525-406e-9352-a049df9ad127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c74fa-6e42-44fe-b9ba-059651f613be]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:16 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:16 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-7d54473f-affe-4687-af16-fa4d514d741e-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Lock "cinder-7d54473f-affe-4687-af16-fa4d514d741e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-quobyte-7d54473f-affe-4687-af16-fa4d514d741e" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-7d54473f-affe-4687-af16-fa4d514d741e" acquired by "delete_volume" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f462b79b-01e5-4784-ab80-bb6dcc386324]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:17 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e Jul 10 06:08:17 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:17 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.882s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:17 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:08:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:17 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 Jul 10 06:08:17 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:17 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e" returned: 0 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:17 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e Jul 10 06:08:17 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:18 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7d54473f-affe-4687-af16-fa4d514d741e" returned: 0 in 1.155s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-7d54473f-affe-4687-af16-fa4d514d741e" released by "delete_volume" :: held 2.084s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Created reservations ['a1519c7e-4d5f-419d-b118-9989c353e05d', 'e6aad4b9-33e5-4063-aec7-3ab44ca94a0b', '492e7b11-3284-42e2-993f-7dfde710c757', '5f163ab8-f95f-45d0-a440-35b81ab0fee7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:19 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:19 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:21 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.677s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:21 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Deleted volume successfully. Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-541dc161-dcb3-4a04-b135-2baeb345ce0b tempest-ProjectReaderTests-557016192 None] Lock "cinder-7d54473f-affe-4687-af16-fa4d514d741e-delete_volume" released by "delete_volume" :: held 4.407s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (7907d77b-498c-400a-bd95-dd4f65d3d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e912fc0-4c8a-4529-b98d-c3d8a2af00c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e912fc0-4c8a-4529-b98d-c3d8a2af00c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689302572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b554ec-3e21-4848-8d93-8d9505a7552c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:21Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9819795d-f056-4e96-8ecf-cde600b03f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9819795d-f056-4e96-8ecf-cde600b03f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d61db27-7dcd-48f0-a009-9cd48b2cb53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d61db27-7dcd-48f0-a009-9cd48b2cb53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b554ec-3e21-4848-8d93-8d9505a7552c', 'volume_name': 'volume-44b554ec-3e21-4848-8d93-8d9505a7552c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4bf2d0-f6d7-4185-b234-ccf8e8887093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4bf2d0-f6d7-4185-b234-ccf8e8887093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1283f1-cf1c-4e13-8a69-4bf06b1b9be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Volume 44b554ec-3e21-4848-8d93-8d9505a7552c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b554ec-3e21-4848-8d93-8d9505a7552c', 'volume_size': 1} Jul 10 06:08:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:23 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8" returned: 0 in 5.663s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b607b-5d0f-48ee-86a6-3dd4c65ce59b]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:23 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:23 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:24 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.958s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:08:24 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Converted 1024.00 MB image at 180.75 MB/s Jul 10 06:08:24 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 is being set with open permissions: ugo+rw Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:24 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 Jul 10 06:08:24 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:24 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8" returned: 0 in 0.657s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-553dc71a-a640-438d-8df3-a0eca56efdc8" released by "_copy_volume_from_snapshot" :: held 9.141s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-8c8f28ac-f879-4477-b4b4-686f0569cfc9-553dc71a-a640-438d-8df3-a0eca56efdc8" released by "_create_volume_from_snapshot" :: held 9.211s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.243s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.203s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Creating offline snapshot 62272f60-2dda-48de-b0ee-337edf9fbc63 of volume 7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3041f85d-7d7b-4b8a-a07b-eb7f2afc6881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553dc71a-a640-438d-8df3-a0eca56efdc8', 'volume_size': 1, 'snapshot_id': '8c8f28ac-f879-4477-b4b4-686f0569cfc9'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940987bc-18ed-4ed2-bada-a737ed73da9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab41d290-e336-420a-b2f5-657b765cea79]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:24 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Volume volume-553dc71a-a640-438d-8df3-a0eca56efdc8 (553dc71a-a640-438d-8df3-a0eca56efdc8): created successfully Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940987bc-18ed-4ed2-bada-a737ed73da9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:24 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Flow 'volume_create_manager' (77bd78f9-288a-4c40-ab7d-4530fbed340f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:24 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f10d7e53-e9cc-4228-b5ea-acf29ead8050 tempest-VolumeDependencyTests-813392224 None] Created volume successfully. Jul 10 06:08:24 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f Jul 10 06:08:24 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:25 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" returned: 0 in 0.793s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-8c8f28ac-f879-4477-b4b4-686f0569cfc9-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:25 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 1G Jul 10 06:08:25 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-8c8f28ac-f879-4477-b4b4-686f0569cfc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-quobyte-2da7eb4c-a525-406e-9352-a049df9ad127" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-2da7eb4c-a525-406e-9352-a049df9ad127" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-quobyte-8c8f28ac-f879-4477-b4b4-686f0569cfc9" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-8c8f28ac-f879-4477-b4b4-686f0569cfc9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Deleting offline snapshot 8c8f28ac-f879-4477-b4b4-686f0569cfc9 of volume 2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] snapshot_file for this snap is: volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[39471bc6-83d3-4d43-8bff-3cd0d15d2956]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:25 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 Jul 10 06:08:25 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:26 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 1G" returned: 0 in 0.919s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:26 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9" returned: 0 in 0.799s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da7eb4c-a525-406e-9352-a049df9ad127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:08:26 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 Jul 10 06:08:26 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:26 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f1f9b-a827-4e4f-a855-f74b25728922]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:26 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:26 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:27 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:27 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 is being set with open permissions: ugo+rw Jul 10 06:08:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:27 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 Jul 10 06:08:27 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:27 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.827s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:27 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 Jul 10 06:08:27 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:28 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63" returned: 0 in 0.714s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:28 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info Jul 10 06:08:28 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:28 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:28 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9 Jul 10 06:08:28 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:28 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info" returned: 0 in 0.685s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:28 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info is being set with open permissions: ugo+rw Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:28 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info Jul 10 06:08:28 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:28 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:28 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:28 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127.8c8f28ac-f879-4477-b4b4-686f0569cfc9" returned: 0 in 0.723s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-8c8f28ac-f879-4477-b4b4-686f0569cfc9" released by "_delete_snapshot" :: held 3.287s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-2da7eb4c-a525-406e-9352-a049df9ad127" released by "delete_snapshot" :: held 3.317s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Created reservations ['15904e31-d30a-4d30-9aec-3a2f7af14608', '7b34b314-53d7-47d5-941b-afc0b080de19', '9bed6e8b-9a43-47c2-bfa8-c857660d76ba', 'ef1f6277-ff23-43c2-9907-665fdfd0918a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Delete snapshot completed successfully. Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-161c535b-b112-4c66-8d9f-2a0204295888 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-8c8f28ac-f879-4477-b4b4-686f0569cfc9-delete_snapshot" released by "delete_snapshot" :: held 3.512s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:29 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.info" returned: 0 in 0.776s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.748s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.833s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689302572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b554ec-3e21-4848-8d93-8d9505a7552c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:21Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Creating volume 44b554ec-3e21-4848-8d93-8d9505a7552c {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:29 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:29 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c 1073741824 Jul 10 06:08:29 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:29 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5746fbb4-00c9-42d1-9ef5-241a66e78d8e tempest-ProjectReaderTests-1558325439 None] Create snapshot completed successfully Jul 10 06:08:29 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.753s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-2da7eb4c-a525-406e-9352-a049df9ad127-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:29 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-2da7eb4c-a525-406e-9352-a049df9ad127-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-quobyte-2da7eb4c-a525-406e-9352-a049df9ad127" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-2da7eb4c-a525-406e-9352-a049df9ad127" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a6795-c1ed-488a-a3e7-c5ab653641f5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:30 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:30 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-62272f60-2dda-48de-b0ee-337edf9fbc63-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-62272f60-2dda-48de-b0ee-337edf9fbc63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-62272f60-2dda-48de-b0ee-337edf9fbc63" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-62272f60-2dda-48de-b0ee-337edf9fbc63" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Deleting offline snapshot 62272f60-2dda-48de-b0ee-337edf9fbc63 of volume 7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] snapshot_file for this snap is: volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13218fc-a348-466a-91cb-99bd5b216082]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:30 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c 1073741824" returned: 0 in 0.976s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:30 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c Jul 10 06:08:30 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:30 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 Jul 10 06:08:30 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:30 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.896s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:30 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127 Jul 10 06:08:30 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:31 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c" returned: 0 in 0.732s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1283f1-cf1c-4e13-8a69-4bf06b1b9be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b554ec-3e21-4848-8d93-8d9505a7552c', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4927bb1a-08de-451b-9697-676b34819f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:31 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Volume volume-44b554ec-3e21-4848-8d93-8d9505a7552c (44b554ec-3e21-4848-8d93-8d9505a7552c): created successfully Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4927bb1a-08de-451b-9697-676b34819f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (7907d77b-498c-400a-bd95-dd4f65d3d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:31 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1d009dd8-9536-43f8-a2a3-956c059476a3 tempest-ProjectReaderTests-557016192 None] Created volume successfully. Jul 10 06:08:31 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63" returned: 0 in 0.933s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419e1f5-e309-4a8d-a2e3-69285188f481]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:31 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f Jul 10 06:08:31 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:31 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-2da7eb4c-a525-406e-9352-a049df9ad127" returned: 0 in 0.847s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-2da7eb4c-a525-406e-9352-a049df9ad127" released by "delete_volume" :: held 1.816s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:31 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Created reservations ['3cc234d1-1504-4006-a893-c474f96f08aa', '3717925c-2c6d-498c-8b76-f8512b4ef572', 'dd666ba2-e109-4059-a263-38a26f853436', 'dc23aa85-f440-456e-9415-ba91a0b121f9'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:32 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:32 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-44b554ec-3e21-4848-8d93-8d9505a7552c-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Lock "cinder-44b554ec-3e21-4848-8d93-8d9505a7552c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-quobyte-44b554ec-3e21-4848-8d93-8d9505a7552c" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-44b554ec-3e21-4848-8d93-8d9505a7552c" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-553dc71a-a640-438d-8df3-a0eca56efdc8-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[73207838-1c56-4077-ae01-21638aacef4e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Lock "cinder-553dc71a-a640-438d-8df3-a0eca56efdc8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Acquiring lock "cinder-quobyte-553dc71a-a640-438d-8df3-a0eca56efdc8" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-553dc71a-a640-438d-8df3-a0eca56efdc8" acquired by "delete_volume" :: waited 0.031s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[865fd541-82a8-4e27-b8fe-488909f647e0]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:32 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c Jul 10 06:08:32 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:32 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" returned: 0 in 1.079s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:32 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 Jul 10 06:08:32 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:32 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 Jul 10 06:08:32 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:32 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.983s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:32 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:33 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Deleted volume successfully. Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-50a2308a-fb5b-4345-84a4-82f2f3f15a07 tempest-VolumeDependencyTests-813392224 None] Lock "cinder-2da7eb4c-a525-406e-9352-a049df9ad127-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:33 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c" returned: 0 in 1.114s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:33 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c Jul 10 06:08:33 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:33 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63" returned: 0 in 0.893s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:33 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63 Jul 10 06:08:33 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:33 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8" returned: 0 in 1.113s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:33 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8 Jul 10 06:08:33 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:34 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-44b554ec-3e21-4848-8d93-8d9505a7552c" returned: 0 in 0.749s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-44b554ec-3e21-4848-8d93-8d9505a7552c" released by "delete_volume" :: held 1.942s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:34 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f.62272f60-2dda-48de-b0ee-337edf9fbc63" returned: 0 in 0.739s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-62272f60-2dda-48de-b0ee-337edf9fbc63" released by "_delete_snapshot" :: held 3.778s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" released by "delete_snapshot" :: held 3.808s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Created reservations ['3d1a3626-008c-4ea4-8c06-73701b1e3ce8', '024faa82-43b3-4986-95e4-f63ba921f440', '9f6f19ac-f7b1-4009-9ab7-0a76bd32fae4', 'f4cfb8d3-00bc-485f-91ef-466aafaf0ad5'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Created reservations ['137b64d9-8579-47bc-8ee2-82618734ffb0', 'c9d40442-ae86-4c87-a8a7-980cb6da809d', '69b6661c-e036-4432-a03d-42892a7a6c16', '1bc33a3e-cd92-490f-9e65-7e433c328a76'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:34 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-553dc71a-a640-438d-8df3-a0eca56efdc8" returned: 0 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Lock "cinder-quobyte-553dc71a-a640-438d-8df3-a0eca56efdc8" released by "delete_volume" :: held 2.013s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Delete snapshot completed successfully. Jul 10 06:08:34 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:34 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b5375752-3cba-49eb-8529-2b590332e316 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-62272f60-2dda-48de-b0ee-337edf9fbc63-delete_snapshot" released by "delete_snapshot" :: held 4.079s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Created reservations ['25857a2b-99d7-41ed-a11c-2f09e5c983a3', 'f1775fac-fc7c-464d-bce9-f0d948e4af58', '09fd08a7-99a4-4898-914f-0cc6c9c71ece', 'b5d27afc-bdd4-446c-a8c7-76adb85c05ec'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:34 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:34 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Lock "cinder-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" acquired by "delete_volume" :: waited 0.026s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02404e-513a-4dc8-b873-d589cc7aa3dd]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:35 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f Jul 10 06:08:35 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (4909b507-5ca7-45f5-8268-1037ae446870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb72942d-d0dd-497f-ac4f-041d9139c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb72942d-d0dd-497f-ac4f-041d9139c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1545842276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf8a180-febe-4bb4-aa97-3261770bd3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:35Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328b5fec-b15a-4333-9124-a10450c91bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328b5fec-b15a-4333-9124-a10450c91bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bce4a8d-8ba0-43f0-b211-a7eecb4851f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bce4a8d-8ba0-43f0-b211-a7eecb4851f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf8a180-febe-4bb4-aa97-3261770bd3f4', 'volume_name': 'volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a49307-22b9-4892-8a6e-25155be52688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a49307-22b9-4892-8a6e-25155be52688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fce495-4c7b-4979-9081-c4f5e7ab7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:35 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Volume 5bf8a180-febe-4bb4-aa97-3261770bd3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4', 'volume_size': 1} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1545842276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf8a180-febe-4bb4-aa97-3261770bd3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea8c5483d6984e77be2fe85d0b67da32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:35Z,use_quota=True,user_id='ece0443851534a3aac7de21165011f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Creating volume 5bf8a180-febe-4bb4-aa97-3261770bd3f4 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:35 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:35 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 1073741824 Jul 10 06:08:35 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:35 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.020s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Deleted volume successfully. Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b8291a93-3b72-4ddf-b511-bd81eab342df tempest-ProjectReaderTests-557016192 None] Lock "cinder-44b554ec-3e21-4848-8d93-8d9505a7552c-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:35 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 1.068s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:35 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Deleted volume successfully. Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-1983a375-e70e-435a-adb1-72ce093f0f9a tempest-VolumeDependencyTests-813392224 None] Lock "cinder-553dc71a-a640-438d-8df3-a0eca56efdc8-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:35 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" returned: 0 in 1.043s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:35 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f Jul 10 06:08:35 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:36 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 1073741824" returned: 0 in 1.141s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:36 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 Jul 10 06:08:36 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:36 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" returned: 0 in 0.837s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:36 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f" released by "delete_volume" :: held 1.980s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:36 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Created reservations ['29f75c9a-6132-4edd-8e78-77106e4e7a4f', 'b0271d4f-a635-49c4-acf3-86c65c729cb9', 'cbc650f1-7bdb-4c42-aed6-83ec5f048b71', '1e63f294-f758-4f7d-805a-b337ab35060b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:37 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:37 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:37 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4" returned: 0 in 0.943s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fce495-4c7b-4979-9081-c4f5e7ab7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a605a0a5-5aa0-486d-8e1f-b9b24dd35b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:37 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Volume volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 (5bf8a180-febe-4bb4-aa97-3261770bd3f4): created successfully Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a605a0a5-5aa0-486d-8e1f-b9b24dd35b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Flow 'volume_create_manager' (4909b507-5ca7-45f5-8268-1037ae446870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c82c4e79-91f4-4620-a6ff-ff0c99224b7d tempest-ProjectReaderTests-557016192 None] Created volume successfully. Jul 10 06:08:37 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.769s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:37 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Deleted volume successfully. Jul 10 06:08:37 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6e66096-b091-4a38-868c-83a9b0991bbb tempest-ProjectReaderTests-1558325439 None] Lock "cinder-7036dc0c-c8c9-4f23-b8db-57fd1ee9ba9f-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-5bf8a180-febe-4bb4-aa97-3261770bd3f4-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Lock "cinder-5bf8a180-febe-4bb4-aa97-3261770bd3f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=231,cinder:SELECT=163,cinder:INSERT=65,cinder:DELETE=21 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=16,cinder:SELECT=164,cinder:INSERT=59,cinder:UPDATE=236 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Acquiring lock "cinder-quobyte-5bf8a180-febe-4bb4-aa97-3261770bd3f4" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-5bf8a180-febe-4bb4-aa97-3261770bd3f4" acquired by "delete_volume" :: waited 0.030s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c5065a-f59e-4019-87de-4fb1d8b87a16]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (df191953-005f-4ac3-8a8d-735574b37bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804ea776-d21b-4808-b311-9fd0270d04f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:38 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 Jul 10 06:08:38 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804ea776-d21b-4808-b311-9fd0270d04f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630039599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806b3f85-e368-4b85-be39-9296578a18ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:39Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a0ca7b-8501-4cb1-81bd-9cb8ef086dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a0ca7b-8501-4cb1-81bd-9cb8ef086dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b72c589-03e8-4111-9ef9-3606d97066a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b72c589-03e8-4111-9ef9-3606d97066a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806b3f85-e368-4b85-be39-9296578a18ee', 'volume_name': 'volume-806b3f85-e368-4b85-be39-9296578a18ee', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88182d7c-f222-49ce-a5c6-4fb29fd830cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88182d7c-f222-49ce-a5c6-4fb29fd830cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38e3939-35c6-4ee3-b34d-47ed6bfdb7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:38 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Volume 806b3f85-e368-4b85-be39-9296578a18ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806b3f85-e368-4b85-be39-9296578a18ee', 'volume_size': 1} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630039599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806b3f85-e368-4b85-be39-9296578a18ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fff0eefaf4c4dfa956fa44cf4de7ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:39Z,use_quota=True,user_id='eb0044cb2b204471936aca0b50c40039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Creating volume 806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:38 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:38 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee 1073741824 Jul 10 06:08:38 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:39 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4" returned: 0 in 0.971s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:39 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4 Jul 10 06:08:39 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:40 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee 1073741824" returned: 0 in 1.167s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:40 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee Jul 10 06:08:40 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:40 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-5bf8a180-febe-4bb4-aa97-3261770bd3f4" returned: 0 in 0.753s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Lock "cinder-quobyte-5bf8a180-febe-4bb4-aa97-3261770bd3f4" released by "delete_volume" :: held 1.793s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Created reservations ['c0d676b9-910d-427a-a71f-52c8accd469b', 'a5e585a0-099c-4082-88f7-35718ab7141b', 'f56e131e-286a-4e7d-8493-94030b9120c8', '0f6ce415-6fb8-4ad1-9c7f-4a37670fef0a'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:40 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:40 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:08:41 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (309092c1-5df9-4691-9b9d-eb49c6c45901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbe7240-518c-405a-83d6-f425ec45285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee" returned: 0 in 1.029s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dbe7240-518c-405a-83d6-f425ec45285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-259410319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd0b120-3598-4259-99d6-71274184d3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:41Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072df602-8b79-430a-9fc7-3340467a50c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072df602-8b79-430a-9fc7-3340467a50c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1881c32d-9959-47b6-9a0b-33129f35db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1881c32d-9959-47b6-9a0b-33129f35db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd0b120-3598-4259-99d6-71274184d3ad', 'volume_name': 'volume-4dd0b120-3598-4259-99d6-71274184d3ad', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78415f2b-50b6-4f7a-9a48-860c42a782b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78415f2b-50b6-4f7a-9a48-860c42a782b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b3c342-9c23-48d3-bb05-0ce725b27775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Volume 4dd0b120-3598-4259-99d6-71274184d3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd0b120-3598-4259-99d6-71274184d3ad', 'volume_size': 1} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-259410319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd0b120-3598-4259-99d6-71274184d3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:08:41Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Creating volume 4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:08:41 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38e3939-35c6-4ee3-b34d-47ed6bfdb7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806b3f85-e368-4b85-be39-9296578a18ee', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982adc6d-7996-40fe-9ee1-3a4c17a2d83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:41 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad 1073741824 Jul 10 06:08:41 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:41 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Volume volume-806b3f85-e368-4b85-be39-9296578a18ee (806b3f85-e368-4b85-be39-9296578a18ee): created successfully Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982adc6d-7996-40fe-9ee1-3a4c17a2d83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Flow 'volume_create_manager' (df191953-005f-4ac3-8a8d-735574b37bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0ffebccb-6935-463f-a31b-4eabc0563a02 tempest-ProjectReaderTests-1558325439 None] Created volume successfully. Jul 10 06:08:41 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:41 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Deleted volume successfully. Jul 10 06:08:41 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-63a4fb40-f39e-40b5-a847-d9027de738f6 tempest-ProjectReaderTests-557016192 None] Lock "cinder-5bf8a180-febe-4bb4-aa97-3261770bd3f4-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:42 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad 1073741824" returned: 0 in 1.188s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:42 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad Jul 10 06:08:42 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:43 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.913s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b3c342-9c23-48d3-bb05-0ce725b27775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd0b120-3598-4259-99d6-71274184d3ad', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e63af18-4720-4e7e-af4d-246430242259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Creating offline snapshot ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 of volume 806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:08:43 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Volume volume-4dd0b120-3598-4259-99d6-71274184d3ad (4dd0b120-3598-4259-99d6-71274184d3ad): created successfully Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e63af18-4720-4e7e-af4d-246430242259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (309092c1-5df9-4691-9b9d-eb49c6c45901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda90a52-8502-4eca-a8d0-5fde3971e4fb]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-93c7be21-f7d2-4cf7-88ed-d01c4acc7b1c tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:08:43 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee Jul 10 06:08:43 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:44 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee" returned: 0 in 0.820s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:44 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 1G Jul 10 06:08:44 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:45 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 1G" returned: 0 in 0.875s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806b3f85-e368-4b85-be39-9296578a18ee -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:45 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806b3f85-e368-4b85-be39-9296578a18ee -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 Jul 10 06:08:45 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:45 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806b3f85-e368-4b85-be39-9296578a18ee -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" returned: 0 in 0.701s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:45 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 is being set with open permissions: ugo+rw Jul 10 06:08:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:45 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 Jul 10 06:08:45 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:46 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:46 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info Jul 10 06:08:46 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:47 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info" returned: 0 in 0.642s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:47 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info is being set with open permissions: ugo+rw Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:47 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info Jul 10 06:08:47 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:47 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.info" returned: 0 in 0.646s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.469s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.033s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb of volume 4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:08:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-34ff6785-e24d-4e5a-aef1-aa7b7429c80b tempest-ProjectReaderTests-1558325439 None] Create snapshot completed successfully Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e502dc1-a1c1-474d-ae2c-3e54360f6218]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:47 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad Jul 10 06:08:47 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:48 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad" returned: 0 in 0.768s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:48 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb 1G Jul 10 06:08:48 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-ec95db98-b7b4-4f11-9c91-d1ab1de2afd1-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Lock "cinder-ec95db98-b7b4-4f11-9c91-d1ab1de2afd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-806b3f85-e368-4b85-be39-9296578a18ee" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-806b3f85-e368-4b85-be39-9296578a18ee" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Deleting offline snapshot ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 of volume 806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] snapshot_file for this snap is: volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a64dbc-76ea-4b8d-b37c-a432485ccfd7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:48 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 Jul 10 06:08:48 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:49 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb 1G" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd0b120-3598-4259-99d6-71274184d3ad -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:49 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd0b120-3598-4259-99d6-71274184d3ad -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb Jul 10 06:08:49 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:49 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" returned: 0 in 0.774s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-806b3f85-e368-4b85-be39-9296578a18ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:08:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4494d157-7f31-42a4-a454-f84fc04c7c0d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:49 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee Jul 10 06:08:49 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:50 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd0b120-3598-4259-99d6-71274184d3ad -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" returned: 0 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:50 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb is being set with open permissions: ugo+rw Jul 10 06:08:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:50 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb Jul 10 06:08:50 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:50 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee" returned: 0 in 0.764s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:50 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 Jul 10 06:08:50 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:50 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" returned: 0 in 0.640s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:50 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info Jul 10 06:08:50 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:51 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" returned: 0 in 0.744s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:51 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1 Jul 10 06:08:51 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:51 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:51 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info is being set with open permissions: ugo+rw Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:51 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info Jul 10 06:08:51 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:51 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee.ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" returned: 0 in 0.656s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-ec95db98-b7b4-4f11-9c91-d1ab1de2afd1" released by "_delete_snapshot" :: held 3.050s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-806b3f85-e368-4b85-be39-9296578a18ee" released by "delete_snapshot" :: held 3.076s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Created reservations ['5317af0c-d2a0-40e2-baea-1caac2fe3f1a', 'dd10e581-d553-4272-b5f8-8785143e4f32', '011a3c9e-14ac-41b2-a188-3c34eb2e5a37', '9429ee70-0acd-4810-a37a-eae9b92afdf1'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Delete snapshot completed successfully. Jul 10 06:08:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-0f581461-8db2-4f88-8e6d-1fd780c8510b tempest-ProjectReaderTests-1558325439 None] Lock "cinder-ec95db98-b7b4-4f11-9c91-d1ab1de2afd1-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:52 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.info" returned: 0 in 0.690s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:52 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9c4d5123-d540-4f37-815a-941da239c2b3 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-806b3f85-e368-4b85-be39-9296578a18ee-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-806b3f85-e368-4b85-be39-9296578a18ee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "cinder-quobyte-806b3f85-e368-4b85-be39-9296578a18ee" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-806b3f85-e368-4b85-be39-9296578a18ee" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bc722-0198-4f92-9f91-c377fcb91d6c]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:52 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Lock "cinder-5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-4dd0b120-3598-4259-99d6-71274184d3ad" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4dd0b120-3598-4259-99d6-71274184d3ad" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:53 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee Jul 10 06:08:53 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb of volume 4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47d4df3-d508-403f-a654-1d65e179cc12]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:53 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb Jul 10 06:08:53 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:53 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee" returned: 0 in 0.780s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:53 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee Jul 10 06:08:53 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:53 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" returned: 0 in 0.820s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dd0b120-3598-4259-99d6-71274184d3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948db0b-4e5a-43a4-ba2d-cef14fe87fc5]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:54 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad Jul 10 06:08:54 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:54 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-806b3f85-e368-4b85-be39-9296578a18ee" returned: 0 in 0.693s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-quobyte-806b3f85-e368-4b85-be39-9296578a18ee" released by "delete_volume" :: held 1.544s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Created reservations ['2c4850d4-e1a3-4a37-86f9-37cbb9d1121b', '03bbcbe1-9dd9-4977-adcd-fdc6815c239b', '5fc6305e-d1a9-4510-aa1f-5cb365099c78', '8801308a-97cb-4924-9cc9-3505247eb1bd'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:54 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:54 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:54 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad" returned: 0 in 0.811s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:54 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb Jul 10 06:08:54 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:55 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.670s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:55 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:55 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Deleted volume successfully. Jul 10 06:08:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c1656b8a-aebf-4acb-b277-63fd7891c4b5 tempest-ProjectReaderTests-1558325439 None] Lock "cinder-806b3f85-e368-4b85-be39-9296578a18ee-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:55 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:55 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb Jul 10 06:08:55 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:56 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad.5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" returned: 0 in 0.693s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb" released by "_delete_snapshot" :: held 3.269s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4dd0b120-3598-4259-99d6-71274184d3ad" released by "delete_snapshot" :: held 3.292s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:56 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Created reservations ['a41aed1e-500f-47d9-8aa1-52849a959a51', 'b6dc906c-808d-40ec-90b4-6110b51a752c', 'bf15ce1a-dc9e-41cd-8262-262b7eec7623', 'c2eca7b4-60dc-43d3-aa85-dc52f7de0f28'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:56 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:08:56 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ea8fe6e4-bcf6-4216-8184-6cd6bbaa16cc tempest-ProjectMemberTests-119994507 None] Lock "cinder-5a3a8151-617e-4a8f-9ea2-cf9446d2e0fb-delete_snapshot" released by "delete_snapshot" :: held 3.459s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-4dd0b120-3598-4259-99d6-71274184d3ad-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Lock "cinder-4dd0b120-3598-4259-99d6-71274184d3ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-4dd0b120-3598-4259-99d6-71274184d3ad" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:08:57 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4dd0b120-3598-4259-99d6-71274184d3ad" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:08:57 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e79f1-49e9-4af3-9c23-6eb76f6f18a8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:08:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:57 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad Jul 10 06:08:57 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:58 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad" returned: 0 in 0.764s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:58 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad Jul 10 06:08:58 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:58 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4dd0b120-3598-4259-99d6-71274184d3ad" returned: 0 in 0.715s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4dd0b120-3598-4259-99d6-71274184d3ad" released by "delete_volume" :: held 1.536s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:08:58 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Created reservations ['8f5db0e5-24ec-4c9b-9b08-e8090f837c0d', 'dea4bf28-92b5-4623-bd7e-f71a9bd43141', '0cff6f40-95cc-402c-a251-f256fb7caa36', '9772a517-8f9c-419d-82f6-12c9960244e1'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:08:59 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:08:59 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:08:59 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.698s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:08:59 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:08:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d8e0599d-4b56-423c-8dd3-ea60bfedb932 tempest-ProjectMemberTests-119994507 None] Lock "cinder-4dd0b120-3598-4259-99d6-71274184d3ad-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (179e2721-ab21-4db5-9ac9-dd6e47d5540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2f50e5-84b5-4220-b41b-5e0cece4551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2f50e5-84b5-4220-b41b-5e0cece4551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310816771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906c606d-77fa-4c7d-b02c-e499601aa649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:00Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c72428a-4a86-4e08-94d0-8256ccf9277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c72428a-4a86-4e08-94d0-8256ccf9277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320f889c-3893-4bd5-bcde-623a7a77e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320f889c-3893-4bd5-bcde-623a7a77e90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906c606d-77fa-4c7d-b02c-e499601aa649', 'volume_name': 'volume-906c606d-77fa-4c7d-b02c-e499601aa649', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b97f41-19d7-4ad1-8a5b-4ed847c017ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b97f41-19d7-4ad1-8a5b-4ed847c017ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97599b7-c003-47a4-9813-f5d700ce8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:00 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Volume 906c606d-77fa-4c7d-b02c-e499601aa649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906c606d-77fa-4c7d-b02c-e499601aa649', 'volume_size': 1} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310816771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906c606d-77fa-4c7d-b02c-e499601aa649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:00Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Creating volume 906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:09:00 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:09:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:00 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 1073741824 Jul 10 06:09:00 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:01 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 1073741824" returned: 0 in 0.916s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:01 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 Jul 10 06:09:01 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:01 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649" returned: 0 in 0.653s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97599b7-c003-47a4-9813-f5d700ce8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906c606d-77fa-4c7d-b02c-e499601aa649', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3454190f-edce-48ac-8b53-e339b1918d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:01 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Volume volume-906c606d-77fa-4c7d-b02c-e499601aa649 (906c606d-77fa-4c7d-b02c-e499601aa649): created successfully Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3454190f-edce-48ac-8b53-e339b1918d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:01 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (179e2721-ab21-4db5-9ac9-dd6e47d5540e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-17a0dddf-3e4e-4f96-b300-a01d6a49f65a tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:09:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:02 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 54042f8d-8693-43be-82e5-f3bfa448280e of volume 906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:09:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4beac6-274b-4afb-8d24-43950b9ba432]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:02 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 Jul 10 06:09:02 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:03 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649" returned: 0 in 0.885s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:03 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e 1G Jul 10 06:09:03 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:04 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e 1G" returned: 0 in 0.887s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906c606d-77fa-4c7d-b02c-e499601aa649 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:04 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906c606d-77fa-4c7d-b02c-e499601aa649 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e Jul 10 06:09:04 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:04 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906c606d-77fa-4c7d-b02c-e499601aa649 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e" returned: 0 in 0.753s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:04 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e is being set with open permissions: ugo+rw Jul 10 06:09:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:04 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e Jul 10 06:09:04 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:05 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e" returned: 0 in 0.634s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:05 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info Jul 10 06:09:05 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:06 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info" returned: 0 in 0.703s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:06 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info is being set with open permissions: ugo+rw Jul 10 06:09:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:06 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info Jul 10 06:09:06 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:06 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.info" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.680s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-72267dba-b98c-46e5-be73-1495e43856e5 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-54042f8d-8693-43be-82e5-f3bfa448280e-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Lock "cinder-54042f8d-8693-43be-82e5-f3bfa448280e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-906c606d-77fa-4c7d-b02c-e499601aa649" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-906c606d-77fa-4c7d-b02c-e499601aa649" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-54042f8d-8693-43be-82e5-f3bfa448280e" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-54042f8d-8693-43be-82e5-f3bfa448280e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 54042f8d-8693-43be-82e5-f3bfa448280e of volume 906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409d871-1750-4b8b-af65-feb0d93c99d2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:07 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e Jul 10 06:09:07 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:08 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e" returned: 0 in 0.777s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:08 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906c606d-77fa-4c7d-b02c-e499601aa649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:09:08 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b5a44-d71c-4a5c-a104-39e2f66c1cd7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:08 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 Jul 10 06:09:08 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:09 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649" returned: 0 in 0.839s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:09 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e Jul 10 06:09:09 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:10 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e" returned: 0 in 0.784s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:10 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e Jul 10 06:09:10 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:10 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649.54042f8d-8693-43be-82e5-f3bfa448280e" returned: 0 in 0.664s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-54042f8d-8693-43be-82e5-f3bfa448280e" released by "_delete_snapshot" :: held 3.185s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-906c606d-77fa-4c7d-b02c-e499601aa649" released by "delete_snapshot" :: held 3.209s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Created reservations ['11d9a657-5c85-4567-b61e-164c08fd3286', '01a3e42b-553f-44f2-96b2-9b619f064d71', '82a2f8cf-0948-4b4b-8e91-3ace552320ed', '586b4db9-156e-45bd-bd03-28fcc23472cc'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:10 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:09:10 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9ea0d336-c314-42b5-8e10-5e78d1a1b205 tempest-ProjectMemberTests-119994507 None] Lock "cinder-54042f8d-8693-43be-82e5-f3bfa448280e-delete_snapshot" released by "delete_snapshot" :: held 3.362s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-906c606d-77fa-4c7d-b02c-e499601aa649-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Lock "cinder-906c606d-77fa-4c7d-b02c-e499601aa649-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-906c606d-77fa-4c7d-b02c-e499601aa649" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:11 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-906c606d-77fa-4c7d-b02c-e499601aa649" acquired by "delete_volume" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:11 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[63057857-ada1-4c4a-881e-1a9b48cc789a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:12 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 Jul 10 06:09:12 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:12 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649" returned: 0 in 0.883s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:12 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649 Jul 10 06:09:12 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:13 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-906c606d-77fa-4c7d-b02c-e499601aa649" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-906c606d-77fa-4c7d-b02c-e499601aa649" released by "delete_volume" :: held 1.681s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Created reservations ['881da06f-49bc-4353-8976-40a67750278c', 'f2bbfd49-909f-4245-8b8b-9ae7d8b504e5', 'a0e1838d-0438-4dbc-9b9b-7c6b2890924b', '0bab8d1d-093c-40f1-b843-cb76a7d90c0c'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:13 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:09:13 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:14 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.712s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:09:14 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-51145c9a-72bf-461a-887b-a803596da4e2 tempest-ProjectMemberTests-119994507 None] Lock "cinder-906c606d-77fa-4c7d-b02c-e499601aa649-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (235de2b9-d6f9-4e4a-99da-555f743d699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccb3d21-e487-4264-b3e7-0a55175ccdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccb3d21-e487-4264-b3e7-0a55175ccdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742322847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46fc2d3-0c64-4310-8068-571efd27fb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:15Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e7e43-51a2-4fc4-acb8-cedafdae53a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e7e43-51a2-4fc4-acb8-cedafdae53a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59482b0-27cf-4e72-bcf5-66f652a5196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59482b0-27cf-4e72-bcf5-66f652a5196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46fc2d3-0c64-4310-8068-571efd27fb7d', 'volume_name': 'volume-f46fc2d3-0c64-4310-8068-571efd27fb7d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa29136-954a-4b86-a72e-40422e5f5924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa29136-954a-4b86-a72e-40422e5f5924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7eec6a6-f036-4de4-a09c-7508dc459a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:14 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Volume f46fc2d3-0c64-4310-8068-571efd27fb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46fc2d3-0c64-4310-8068-571efd27fb7d', 'volume_size': 1} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742322847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46fc2d3-0c64-4310-8068-571efd27fb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:15Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Creating volume f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:09:14 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:09:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:14 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d 1073741824 Jul 10 06:09:14 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:15 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d 1073741824" returned: 0 in 0.874s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:15 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d Jul 10 06:09:15 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:16 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d" returned: 0 in 0.647s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7eec6a6-f036-4de4-a09c-7508dc459a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46fc2d3-0c64-4310-8068-571efd27fb7d', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848582ab-98ca-422c-9aec-f37934206695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:16 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Volume volume-f46fc2d3-0c64-4310-8068-571efd27fb7d (f46fc2d3-0c64-4310-8068-571efd27fb7d): created successfully Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848582ab-98ca-422c-9aec-f37934206695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (235de2b9-d6f9-4e4a-99da-555f743d699e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:16 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ceb01675-e98e-4c13-94a8-c12d4fac7cb7 tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 286e76e3-5690-4f23-b13f-32820921b557 of volume f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0852087-1d6e-4c36-9920-ebcc337de1db]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:17 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d Jul 10 06:09:17 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:17 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d" returned: 0 in 0.849s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:17 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 1G Jul 10 06:09:17 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:18 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 1G" returned: 0 in 0.867s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46fc2d3-0c64-4310-8068-571efd27fb7d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:18 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46fc2d3-0c64-4310-8068-571efd27fb7d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 Jul 10 06:09:18 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:19 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46fc2d3-0c64-4310-8068-571efd27fb7d -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:19 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 is being set with open permissions: ugo+rw Jul 10 06:09:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:19 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 Jul 10 06:09:19 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:20 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:20 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info Jul 10 06:09:20 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:20 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info" returned: 0 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:20 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info is being set with open permissions: ugo+rw Jul 10 06:09:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:20 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info Jul 10 06:09:20 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:21 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.info" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.600s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:21 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-0f5e5402-42f6-4f3c-acb2-92fc0783f191 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-286e76e3-5690-4f23-b13f-32820921b557-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-286e76e3-5690-4f23-b13f-32820921b557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-f46fc2d3-0c64-4310-8068-571efd27fb7d" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f46fc2d3-0c64-4310-8068-571efd27fb7d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-286e76e3-5690-4f23-b13f-32820921b557" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-286e76e3-5690-4f23-b13f-32820921b557" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 286e76e3-5690-4f23-b13f-32820921b557 of volume f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e220ea-38a9-41ab-80d3-deefb64fc0e3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:22 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 Jul 10 06:09:22 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:23 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f46fc2d3-0c64-4310-8068-571efd27fb7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f6573c-8335-4d79-88e9-fe50768399a4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:23 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d Jul 10 06:09:23 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Flow 'volume_create_manager' (1aa34549-02a6-4377-b077-05697876e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9979df-7f3d-4f08-9071-5efe0821229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9979df-7f3d-4f08-9071-5efe0821229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-953221086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63976cda-2222-43b3-8e18-9247687feddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ceb2be90ff40ab86f37ce695c15101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:24Z,use_quota=True,user_id='db1613f94efb45c3b2abd8ff9efb3c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4212c6e-e532-482f-8363-a53db0e29b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4212c6e-e532-482f-8363-a53db0e29b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dae5ed-b0ec-4a3a-9641-cb0612d8cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dae5ed-b0ec-4a3a-9641-cb0612d8cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63976cda-2222-43b3-8e18-9247687feddb', 'volume_name': 'volume-63976cda-2222-43b3-8e18-9247687feddb', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccbc8a0-af27-47ba-a573-9863c1c0a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccbc8a0-af27-47ba-a573-9863c1c0a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2a599f-9d93-46c5-945b-b3770683fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:23 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Volume 63976cda-2222-43b3-8e18-9247687feddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63976cda-2222-43b3-8e18-9247687feddb', 'volume_size': 1} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-953221086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63976cda-2222-43b3-8e18-9247687feddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ceb2be90ff40ab86f37ce695c15101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:24Z,use_quota=True,user_id='db1613f94efb45c3b2abd8ff9efb3c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Creating volume 63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:09:23 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:23 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb 1073741824 Jul 10 06:09:23 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:23 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:23 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 Jul 10 06:09:23 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:24 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb 1073741824" returned: 0 in 0.852s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:24 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557" returned: 0 in 0.777s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:24 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557 Jul 10 06:09:24 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:24 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:24 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:25 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d.286e76e3-5690-4f23-b13f-32820921b557" returned: 0 in 0.640s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:25 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.650s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-286e76e3-5690-4f23-b13f-32820921b557" released by "_delete_snapshot" :: held 3.132s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f46fc2d3-0c64-4310-8068-571efd27fb7d" released by "delete_snapshot" :: held 3.163s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2a599f-9d93-46c5-945b-b3770683fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63976cda-2222-43b3-8e18-9247687feddb', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f90f063-81d0-4f04-b106-e87cb0a958ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:25 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Volume volume-63976cda-2222-43b3-8e18-9247687feddb (63976cda-2222-43b3-8e18-9247687feddb): created successfully Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f90f063-81d0-4f04-b106-e87cb0a958ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Flow 'volume_create_manager' (1aa34549-02a6-4377-b077-05697876e332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-54a9fc68-645f-4d06-981d-be94de1544f6 tempest-SnapshotDependencyTests-1145787604 None] Created volume successfully. Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Created reservations ['e75e7d0c-991d-4adb-885d-af7ae068e0ce', 'ee6e5776-9272-4bda-8636-434d467c0b67', '77540929-d9e2-469d-b4d8-f938f6a2a93c', '8e9efed1-d724-4659-aee2-2d0687960ee9'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:25 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:09:25 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-4a34ef56-3390-4f30-bc7a-c22d3b8b45c8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-286e76e3-5690-4f23-b13f-32820921b557-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Creating offline snapshot 7df657f7-33f0-47de-ba16-cf74ff7c299d of volume 63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[e490603d-9799-433f-b616-776cc0f3c6a8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:26 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:26 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-f46fc2d3-0c64-4310-8068-571efd27fb7d-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Lock "cinder-f46fc2d3-0c64-4310-8068-571efd27fb7d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-f46fc2d3-0c64-4310-8068-571efd27fb7d" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f46fc2d3-0c64-4310-8068-571efd27fb7d" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c776127f-3924-4656-8ed6-509eff82e3c2]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:26 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d Jul 10 06:09:26 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:26 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.767s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:26 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d 1G Jul 10 06:09:26 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:27 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d" returned: 0 in 0.770s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:27 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d Jul 10 06:09:27 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:27 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d 1G" returned: 0 in 0.807s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63976cda-2222-43b3-8e18-9247687feddb -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:27 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63976cda-2222-43b3-8e18-9247687feddb -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d Jul 10 06:09:27 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:27 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f46fc2d3-0c64-4310-8068-571efd27fb7d" returned: 0 in 0.651s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f46fc2d3-0c64-4310-8068-571efd27fb7d" released by "delete_volume" :: held 1.479s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Created reservations ['537e2370-229b-485f-bef2-3a1126c8b068', '35c03677-4f87-4439-acd3-1940f1e12819', '4d2bb8e7-d12b-4c4c-a461-27d370f8ecbd', '673f32af-1838-4b52-9232-3b43154c18bf'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:28 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:09:28 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:28 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63976cda-2222-43b3-8e18-9247687feddb -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d" returned: 0 in 0.722s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:28 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d is being set with open permissions: ugo+rw Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:28 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d Jul 10 06:09:28 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:28 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.657s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:09:28 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3921e478-7bdf-4bdf-a5a0-4ac65a80b6ae tempest-ProjectMemberTests-119994507 None] Lock "cinder-f46fc2d3-0c64-4310-8068-571efd27fb7d-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:28 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:09:28 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:28 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d" returned: 0 in 0.650s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:29 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info Jul 10 06:09:29 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (0f757588-1377-4ec5-913e-695e31ca57f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa03f84-f1fa-4a28-8468-75aa1a834607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa03f84-f1fa-4a28-8468-75aa1a834607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696503515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f43567-7639-4f5b-840a-f4dd440a0513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:29Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b32ff6-f114-4cb9-9d9c-b3b491496897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b32ff6-f114-4cb9-9d9c-b3b491496897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801c51c4-9a87-4581-b0ae-b13acae88b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801c51c4-9a87-4581-b0ae-b13acae88b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f43567-7639-4f5b-840a-f4dd440a0513', 'volume_name': 'volume-e0f43567-7639-4f5b-840a-f4dd440a0513', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce38462-8900-44aa-91ee-035855427dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce38462-8900-44aa-91ee-035855427dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07238ac8-6f5b-4dd1-a579-883ad5dc070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:29 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Volume e0f43567-7639-4f5b-840a-f4dd440a0513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f43567-7639-4f5b-840a-f4dd440a0513', 'volume_size': 1} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:29 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:09:29 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info" returned: 0 in 0.681s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:29 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info is being set with open permissions: ugo+rw Jul 10 06:09:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:29 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info Jul 10 06:09:29 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:30 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.info" returned: 0 in 0.634s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696503515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f43567-7639-4f5b-840a-f4dd440a0513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:29Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Creating volume e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:09:30 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:09:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:30 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 1073741824 Jul 10 06:09:30 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-fee5fbf8-f37e-4823-862a-1210177bc8e4 tempest-SnapshotDependencyTests-1145787604 None] Create snapshot completed successfully Jul 10 06:09:31 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 1073741824" returned: 0 in 0.817s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:31 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 Jul 10 06:09:31 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Flow 'volume_create_manager' (49a9838d-fffd-4027-adb1-15a53d39b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24aa40d5-1d31-47cd-b440-cf0c5167e3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24aa40d5-1d31-47cd-b440-cf0c5167e3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227e7d29-cd1c-4c22-aad4-8c05fd397d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ceb2be90ff40ab86f37ce695c15101',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7df657f7-33f0-47de-ba16-cf74ff7c299d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:32Z,use_quota=True,user_id='db1613f94efb45c3b2abd8ff9efb3c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef22f19d-3cfd-4b72-ab10-79795192f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef22f19d-3cfd-4b72-ab10-79795192f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc17458-4611-4ff2-9048-a0b4aa6bc285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc17458-4611-4ff2-9048-a0b4aa6bc285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '227e7d29-cd1c-4c22-aad4-8c05fd397d2a', 'volume_name': 'volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a', 'volume_size': 1, 'snapshot_id': '7df657f7-33f0-47de-ba16-cf74ff7c299d'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e66c9ed-ee51-4c84-9d59-1b12e4f13feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e66c9ed-ee51-4c84-9d59-1b12e4f13feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e3a96b-3c86-4bb3-9f10-710abbb215fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:31 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Volume 227e7d29-cd1c-4c22-aad4-8c05fd397d2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a', 'volume_size': 1, 'snapshot_id': '7df657f7-33f0-47de-ba16-cf74ff7c299d'} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:31 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513" returned: 0 in 0.658s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.014s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-quobyte-7df657f7-33f0-47de-ba16-cf74ff7c299d-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" by "_create_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07238ac8-6f5b-4dd1-a579-883ad5dc070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f43567-7639-4f5b-840a-f4dd440a0513', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265ca2ee-ea32-4418-b350-e6a269c00cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-7df657f7-33f0-47de-ba16-cf74ff7c299d-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Creating volume 227e7d29-cd1c-4c22-aad4-8c05fd397d2a from snapshot 7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-quobyte-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" by "_copy_volume_from_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:31 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Volume volume-e0f43567-7639-4f5b-840a-f4dd440a0513 (e0f43567-7639-4f5b-840a-f4dd440a0513): created successfully Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265ca2ee-ea32-4418-b350-e6a269c00cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (0f757588-1377-4ec5-913e-695e31ca57f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] snapshot: 7df657f7-33f0-47de-ba16-cf74ff7c299d, volume: 227e7d29-cd1c-4c22-aad4-8c05fd397d2a, {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:31 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d82e79f1-8767-40a3-b1b6-bda5620f31d9 tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[292ff589-d5fe-46b9-ba4f-347c217942b4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:32 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d Jul 10 06:09:32 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:32 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63976cda-2222-43b3-8e18-9247687feddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Creating direct copy from snapshot {{(pid=87449) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0760cbe-3a17-4c4f-8607-7e6626a54d1d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:32 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:32 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:33 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.754s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:33 devstack cinder-volume[87449]: DEBUG cinder.utils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Path /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a not found in is_blk_device check {{(pid=87449) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:09:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:33 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a Jul 10 06:09:33 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:38 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" returned: 0 in 4.481s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:38 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9386bc5-829d-46a3-97e6-0f90fecd060a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:38 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:38 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:38 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.941s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:38 devstack cinder-volume[87449]: DEBUG cinder.image.image_utils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Image conversion details: src /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a {{(pid=87449) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 10 06:09:38 devstack cinder-volume[87449]: INFO cinder.image.image_utils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Converted 1024.00 MB image at 228.43 MB/s Jul 10 06:09:38 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a is being set with open permissions: ugo+rw Jul 10 06:09:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:38 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a Jul 10 06:09:38 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:39 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" returned: 0 in 0.654s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" released by "_copy_volume_from_snapshot" :: held 7.681s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-7df657f7-33f0-47de-ba16-cf74ff7c299d-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" released by "_create_volume_from_snapshot" :: held 7.726s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.756s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.218s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=81,cinder:UPDATE=83,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=94,cinder:SELECT=69,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 1aa12e25-7ad2-4a50-bd23-2dd2119581f5 of volume e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e3a96b-3c86-4bb3-9f10-710abbb215fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a', 'volume_size': 1, 'snapshot_id': '7df657f7-33f0-47de-ba16-cf74ff7c299d'}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1638bb4e-d2ab-4399-bec6-2a5f15b03a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936ae77-4221-456e-80ff-0d86ddf59335]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:39 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Volume volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a (227e7d29-cd1c-4c22-aad4-8c05fd397d2a): created successfully Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1638bb4e-d2ab-4399-bec6-2a5f15b03a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:39 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Flow 'volume_create_manager' (49a9838d-fffd-4027-adb1-15a53d39b19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-46a04ebd-ecb7-46ca-b8aa-04d77efa84ac tempest-SnapshotDependencyTests-1145787604 None] Created volume successfully. Jul 10 06:09:39 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 Jul 10 06:09:39 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:40 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513" returned: 0 in 0.782s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:40 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 1G Jul 10 06:09:40 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-7df657f7-33f0-47de-ba16-cf74ff7c299d-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-7df657f7-33f0-47de-ba16-cf74ff7c299d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-quobyte-63976cda-2222-43b3-8e18-9247687feddb" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-63976cda-2222-43b3-8e18-9247687feddb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-quobyte-7df657f7-33f0-47de-ba16-cf74ff7c299d" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-7df657f7-33f0-47de-ba16-cf74ff7c299d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Deleting offline snapshot 7df657f7-33f0-47de-ba16-cf74ff7c299d of volume 63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] snapshot_file for this snap is: volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[50796d44-1c96-457e-be97-5b3395ead30d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:40 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d Jul 10 06:09:40 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:41 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 1G" returned: 0 in 0.857s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f43567-7639-4f5b-840a-f4dd440a0513 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:41 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f43567-7639-4f5b-840a-f4dd440a0513 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 Jul 10 06:09:41 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:41 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d" returned: 0 in 0.805s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63976cda-2222-43b3-8e18-9247687feddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:09:41 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7bfe3e-621a-4fab-940d-e8229bcab103]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:41 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:41 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:42 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f43567-7639-4f5b-840a-f4dd440a0513 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:42 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 is being set with open permissions: ugo+rw Jul 10 06:09:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:42 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 Jul 10 06:09:42 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:42 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.791s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:42 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d Jul 10 06:09:42 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:42 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5" returned: 0 in 0.649s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:42 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info Jul 10 06:09:42 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:43 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d" returned: 0 in 0.754s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:43 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d Jul 10 06:09:43 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:43 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info" returned: 0 in 0.667s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:43 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info is being set with open permissions: ugo+rw Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:43 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info Jul 10 06:09:43 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:43 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb.7df657f7-33f0-47de-ba16-cf74ff7c299d" returned: 0 in 0.661s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-7df657f7-33f0-47de-ba16-cf74ff7c299d" released by "_delete_snapshot" :: held 3.149s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-63976cda-2222-43b3-8e18-9247687feddb" released by "delete_snapshot" :: held 3.178s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Created reservations ['4a5641c0-c92e-41d2-87f3-59c1e9ae94a9', '994dc262-cf93-4612-9aca-85158ae45a1e', '9204cbbd-e6f1-4b6c-a5f9-c20e95133bea', '5db446c7-81a7-4b31-b2cf-f3953545113f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Delete snapshot completed successfully. Jul 10 06:09:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-d6bde128-c4ae-481e-8390-b3dd05988b69 tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-7df657f7-33f0-47de-ba16-cf74ff7c299d-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:44 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.info" returned: 0 in 0.665s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.452s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:44 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-81cb8f2a-a54d-4645-86b6-bb3ae3908f21 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-63976cda-2222-43b3-8e18-9247687feddb-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-63976cda-2222-43b3-8e18-9247687feddb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-quobyte-63976cda-2222-43b3-8e18-9247687feddb" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-63976cda-2222-43b3-8e18-9247687feddb" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c2eb73-d309-4c7c-ab7c-ebad5458463e]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:44 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:44 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-1aa12e25-7ad2-4a50-bd23-2dd2119581f5-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Lock "cinder-1aa12e25-7ad2-4a50-bd23-2dd2119581f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-e0f43567-7639-4f5b-840a-f4dd440a0513" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-e0f43567-7639-4f5b-840a-f4dd440a0513" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-1aa12e25-7ad2-4a50-bd23-2dd2119581f5" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-1aa12e25-7ad2-4a50-bd23-2dd2119581f5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 1aa12e25-7ad2-4a50-bd23-2dd2119581f5 of volume e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3669b-0eb8-4f99-80d3-6c338dde33a8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:45 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 Jul 10 06:09:45 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:45 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:45 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb Jul 10 06:09:45 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:46 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5" returned: 0 in 0.834s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f43567-7639-4f5b-840a-f4dd440a0513(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[98069544-6b65-4341-902c-2e187c76b5af]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:46 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 Jul 10 06:09:46 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:46 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-63976cda-2222-43b3-8e18-9247687feddb" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-63976cda-2222-43b3-8e18-9247687feddb" released by "delete_volume" :: held 1.503s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Created reservations ['6bd04690-39a1-4b6d-93e6-e83cf1d995c7', 'ef08d59e-8238-4da3-8ef6-3962242b706a', 'e98c0e71-6c8a-494a-b23b-816bf153c92c', '4c0a0cf3-c4bf-4fd6-a7ef-92130ef4dbd2'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:46 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:09:46 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:46 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513" returned: 0 in 0.800s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:46 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 Jul 10 06:09:46 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-227e7d29-cd1c-4c22-aad4-8c05fd397d2a-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-227e7d29-cd1c-4c22-aad4-8c05fd397d2a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "cinder-quobyte-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a7abbf-e347-4139-acce-ca7caefd4a22]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:47 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.724s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:09:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Deleted volume successfully. Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-9cdb200d-293d-498b-9ab2-9311dd85346a tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-63976cda-2222-43b3-8e18-9247687feddb-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:47 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a Jul 10 06:09:47 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:47 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5" returned: 0 in 0.812s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:47 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5 Jul 10 06:09:47 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:47 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" returned: 0 in 0.806s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:47 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a Jul 10 06:09:47 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:48 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513.1aa12e25-7ad2-4a50-bd23-2dd2119581f5" returned: 0 in 0.704s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-1aa12e25-7ad2-4a50-bd23-2dd2119581f5" released by "_delete_snapshot" :: held 3.248s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-e0f43567-7639-4f5b-840a-f4dd440a0513" released by "delete_snapshot" :: held 3.275s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Created reservations ['726f816f-6f92-46d2-b616-97ef282d3295', '92394424-51f5-4aff-8f26-2fe50f00d561', '7c7beea7-bcb7-4a9d-87c1-fe88a18f383f', 'ec3cfdb3-cbb7-416b-abb5-06158e451cae'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:48 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-5a0dd8da-c7ef-4a89-8949-b949c8c1708c tempest-ProjectMemberTests-119994507 None] Lock "cinder-1aa12e25-7ad2-4a50-bd23-2dd2119581f5-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:48 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" returned: 0 in 0.706s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-quobyte-227e7d29-cd1c-4c22-aad4-8c05fd397d2a" released by "delete_volume" :: held 1.565s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Created reservations ['254b80cb-30bd-476d-82ba-2b22098816a5', '367bd224-0bed-40e6-b7cd-682160867901', '32ad1ca4-caca-4e07-a241-50cc8c2d6a73', 'b662284d-c267-4329-a2c5-086fb645046f'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:48 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:09:48 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-e0f43567-7639-4f5b-840a-f4dd440a0513-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Lock "cinder-e0f43567-7639-4f5b-840a-f4dd440a0513-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-e0f43567-7639-4f5b-840a-f4dd440a0513" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-e0f43567-7639-4f5b-840a-f4dd440a0513" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f38b5a-4442-49b9-a742-766be659bfad]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:49 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.720s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:09:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Deleted volume successfully. Jul 10 06:09:49 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-e2ed3afc-406c-4adf-8054-2bf787efb7be tempest-SnapshotDependencyTests-1145787604 None] Lock "cinder-227e7d29-cd1c-4c22-aad4-8c05fd397d2a-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:49 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 Jul 10 06:09:49 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:50 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513" returned: 0 in 0.881s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:50 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513 Jul 10 06:09:50 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:51 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-e0f43567-7639-4f5b-840a-f4dd440a0513" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-e0f43567-7639-4f5b-840a-f4dd440a0513" released by "delete_volume" :: held 1.624s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Created reservations ['ebb7cb1c-f378-4cbe-be49-0d2560819cd9', '42a1e5f1-da01-4233-9e40-c356cf4d2ad5', 'b64b26c5-612c-4e38-8859-beeb6a12e909', '4737fb52-a311-4052-8f6d-d46b42a06a36'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:51 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:09:51 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:51 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.733s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:09:51 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:09:51 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-7a4d549e-a481-4940-86a6-609f2f443c95 tempest-ProjectMemberTests-119994507 None] Lock "cinder-e0f43567-7639-4f5b-840a-f4dd440a0513-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (581d8b96-5a88-4403-b1cc-3e3c29167bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd30878-db19-444f-9b60-0d5580e6f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd30878-db19-444f-9b60-0d5580e6f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300336301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7903b7d5-3710-44bf-aef4-b8ef28b13a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:52Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c129ccb-2b2c-45ea-a844-f453b0266953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c129ccb-2b2c-45ea-a844-f453b0266953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1824b9-3e39-4b3e-9350-9f42772b099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1824b9-3e39-4b3e-9350-9f42772b099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7903b7d5-3710-44bf-aef4-b8ef28b13a27', 'volume_name': 'volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af6e120-e0fe-41f5-bd92-ac6383f9f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af6e120-e0fe-41f5-bd92-ac6383f9f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738b87fd-9a0e-4311-8a2a-9e0711ec64ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:52 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Volume 7903b7d5-3710-44bf-aef4-b8ef28b13a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27', 'volume_size': 1} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300336301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7903b7d5-3710-44bf-aef4-b8ef28b13a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:09:52Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Creating volume 7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:09:52 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:09:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:52 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 1073741824 Jul 10 06:09:52 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:53 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 1073741824" returned: 0 in 0.943s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:53 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 Jul 10 06:09:53 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:54 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27" returned: 0 in 0.700s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738b87fd-9a0e-4311-8a2a-9e0711ec64ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d981d9-bb23-45b5-954b-a6544eec6a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:09:54 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Volume volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 (7903b7d5-3710-44bf-aef4-b8ef28b13a27): created successfully Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d981d9-bb23-45b5-954b-a6544eec6a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (581d8b96-5a88-4403-b1cc-3e3c29167bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:09:54 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-e3152737-a160-4592-9288-7591b22c27b9 tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 08cd61e4-e8bc-4949-9e25-7a5719f26178 of volume 7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[732a701f-4b7a-4d14-83c3-cb1f324936ee]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:54 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:54 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 Jul 10 06:09:54 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:55 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27" returned: 0 in 0.803s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:55 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 1G Jul 10 06:09:55 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:56 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 1G" returned: 0 in 0.891s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:56 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 Jul 10 06:09:56 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:56 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178" returned: 0 in 0.714s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:56 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 is being set with open permissions: ugo+rw Jul 10 06:09:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:56 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 Jul 10 06:09:56 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:57 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178" returned: 0 in 0.709s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:57 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info Jul 10 06:09:57 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:58 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info" returned: 0 in 0.686s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:58 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info is being set with open permissions: ugo+rw Jul 10 06:09:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:58 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info Jul 10 06:09:58 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:09:58 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 10 06:09:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.info" returned: 0 in 0.634s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:09:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.530s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:09:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4a4beb27-0c1f-45bb-a8bb-984cf7c77fb4 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-08cd61e4-e8bc-4949-9e25-7a5719f26178-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Lock "cinder-08cd61e4-e8bc-4949-9e25-7a5719f26178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-7903b7d5-3710-44bf-aef4-b8ef28b13a27" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-7903b7d5-3710-44bf-aef4-b8ef28b13a27" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-08cd61e4-e8bc-4949-9e25-7a5719f26178" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-08cd61e4-e8bc-4949-9e25-7a5719f26178" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 08cd61e4-e8bc-4949-9e25-7a5719f26178 of volume 7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f4306-6204-4cd8-bc44-47067b557613]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:09:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:09:59 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 Jul 10 06:09:59 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:00 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178" returned: 0 in 0.766s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:10:00 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0216b5e8-b204-44d2-99e1-2cf845beb025]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:00 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 Jul 10 06:10:00 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:01 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27" returned: 0 in 0.750s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:01 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 Jul 10 06:10:01 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:02 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178" returned: 0 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:02 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178 Jul 10 06:10:02 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:02 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27.08cd61e4-e8bc-4949-9e25-7a5719f26178" returned: 0 in 0.627s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-08cd61e4-e8bc-4949-9e25-7a5719f26178" released by "_delete_snapshot" :: held 2.948s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-7903b7d5-3710-44bf-aef4-b8ef28b13a27" released by "delete_snapshot" :: held 2.971s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Created reservations ['7147de8d-9d3d-411f-8d1a-746fecf0f49f', 'd856c73d-c145-4260-8673-d25909d5968e', 'ef4220d4-f488-4fc1-b2a2-da559551cf25', '2b942fa4-d7de-4e41-87be-57ebb97e9d24'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:02 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b04ffcaf-67b2-4a09-8157-6196c0cb8726 tempest-ProjectMemberTests-119994507 None] Lock "cinder-08cd61e4-e8bc-4949-9e25-7a5719f26178-delete_snapshot" released by "delete_snapshot" :: held 3.120s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-7903b7d5-3710-44bf-aef4-b8ef28b13a27-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Lock "cinder-7903b7d5-3710-44bf-aef4-b8ef28b13a27-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-7903b7d5-3710-44bf-aef4-b8ef28b13a27" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-7903b7d5-3710-44bf-aef4-b8ef28b13a27" acquired by "delete_volume" :: waited 0.012s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d02888-f2c7-456d-a401-7c7353d77974]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:02 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:03 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 Jul 10 06:10:03 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:03 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27" returned: 0 in 0.765s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:03 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:03 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27 Jul 10 06:10:03 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:04 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-7903b7d5-3710-44bf-aef4-b8ef28b13a27" returned: 0 in 0.633s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-7903b7d5-3710-44bf-aef4-b8ef28b13a27" released by "delete_volume" :: held 1.463s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Created reservations ['e4f67af3-6fd2-4e9e-b8d4-e09678073b90', '064ca1f5-fd89-4a8d-956a-d1ccc3b9bd27', '7e6ad020-3323-4199-8346-c49b2b226ca7', '96789563-c66d-454a-a24b-6758c61057a7'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:04 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:04 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:10:04 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:05 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.631s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:10:05 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-881eada9-c0c1-4184-8162-587c3ff56a82 tempest-ProjectMemberTests-119994507 None] Lock "cinder-7903b7d5-3710-44bf-aef4-b8ef28b13a27-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (b5af706c-edef-48b3-bf66-5e16d89eb0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f13815-8d16-4c05-b2d5-b4b4400d61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f13815-8d16-4c05-b2d5-b4b4400d61b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51174035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f527d06b-5ea7-4030-937d-e23b3e676bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:05Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e8828c-526e-47df-b1ed-6ddf2b0c54e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e8828c-526e-47df-b1ed-6ddf2b0c54e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c77cfc-1617-4b10-b5c4-553a11a7dff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c77cfc-1617-4b10-b5c4-553a11a7dff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f527d06b-5ea7-4030-937d-e23b3e676bb9', 'volume_name': 'volume-f527d06b-5ea7-4030-937d-e23b3e676bb9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a4ea35-01ce-4e74-aaa0-ef1f5af840bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a4ea35-01ce-4e74-aaa0-ef1f5af840bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff23d69-0125-4a84-9e59-55d9880822d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:05 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Volume f527d06b-5ea7-4030-937d-e23b3e676bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f527d06b-5ea7-4030-937d-e23b3e676bb9', 'volume_size': 1} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51174035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f527d06b-5ea7-4030-937d-e23b3e676bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:05Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Creating volume f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:10:05 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:10:05 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:05 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 1073741824 Jul 10 06:10:05 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:06 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 1073741824" returned: 0 in 0.825s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:06 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:06 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 Jul 10 06:10:06 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:07 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9" returned: 0 in 0.662s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff23d69-0125-4a84-9e59-55d9880822d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f527d06b-5ea7-4030-937d-e23b3e676bb9', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc03675c-7778-4825-83f5-a5c8e16718c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:07 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Volume volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 (f527d06b-5ea7-4030-937d-e23b3e676bb9): created successfully Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc03675c-7778-4825-83f5-a5c8e16718c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (b5af706c-edef-48b3-bf66-5e16d89eb0a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:07 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-7f5222be-1ca6-4f48-9b87-d36102758873 tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 9fb2f3aa-5476-4241-b4f6-6142da9b7c52 of volume f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a239f3-0c16-4fc6-b497-12f78ded1257]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:07 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:07 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 Jul 10 06:10:07 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:08 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9" returned: 0 in 0.760s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:08 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:08 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 1G Jul 10 06:10:08 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:09 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 1G" returned: 0 in 0.798s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:09 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:09 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 Jul 10 06:10:09 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:10 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:10 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 is being set with open permissions: ugo+rw Jul 10 06:10:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:10 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 Jul 10 06:10:10 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:10 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52" returned: 0 in 0.688s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:10 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:10 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info Jul 10 06:10:10 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:11 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info" returned: 0 in 0.650s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:11 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info is being set with open permissions: ugo+rw Jul 10 06:10:11 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:11 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info Jul 10 06:10:11 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:12 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.info" returned: 0 in 0.674s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:12 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.392s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:12 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-d021a0d2-dc5c-4b74-aba8-a6f6cfda3579 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:10:12 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-9fb2f3aa-5476-4241-b4f6-6142da9b7c52-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Lock "cinder-9fb2f3aa-5476-4241-b4f6-6142da9b7c52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-f527d06b-5ea7-4030-937d-e23b3e676bb9" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f527d06b-5ea7-4030-937d-e23b3e676bb9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-9fb2f3aa-5476-4241-b4f6-6142da9b7c52" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-9fb2f3aa-5476-4241-b4f6-6142da9b7c52" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 9fb2f3aa-5476-4241-b4f6-6142da9b7c52 of volume f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[50761edb-c7f4-4a64-a852-fd0f77bd97db]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:13 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 Jul 10 06:10:13 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:13 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52" returned: 0 in 0.763s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f527d06b-5ea7-4030-937d-e23b3e676bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d72793-d2f1-4894-8b37-ca494e6c2ed4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:13 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:13 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 Jul 10 06:10:13 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:14 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:14 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:14 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 Jul 10 06:10:14 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:15 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52" returned: 0 in 0.743s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:15 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:15 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52 Jul 10 06:10:15 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:16 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:16 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9.9fb2f3aa-5476-4241-b4f6-6142da9b7c52" returned: 0 in 0.651s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-9fb2f3aa-5476-4241-b4f6-6142da9b7c52" released by "_delete_snapshot" :: held 3.041s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f527d06b-5ea7-4030-937d-e23b3e676bb9" released by "delete_snapshot" :: held 3.067s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:16 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Created reservations ['2ea4f2e2-c8ac-4e7a-b3ed-7519dd5c36c5', 'a7f181b6-475e-4b30-95ac-61636b43305e', '6be52fce-ee9a-4178-99b6-0098aa535b79', '9a0c43f5-cc57-4b88-b843-9526ce74a931'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:16 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:10:16 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-ec60e7b5-8bb3-41d1-b177-b539888618e0 tempest-ProjectMemberTests-119994507 None] Lock "cinder-9fb2f3aa-5476-4241-b4f6-6142da9b7c52-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-f527d06b-5ea7-4030-937d-e23b3e676bb9-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-f527d06b-5ea7-4030-937d-e23b3e676bb9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-f527d06b-5ea7-4030-937d-e23b3e676bb9" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:17 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f527d06b-5ea7-4030-937d-e23b3e676bb9" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:17 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c6e9dd-71bc-41af-85ca-4d7133535498]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:17 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:17 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 Jul 10 06:10:17 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:18 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9" returned: 0 in 0.782s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:18 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9 Jul 10 06:10:18 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:18 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f527d06b-5ea7-4030-937d-e23b3e676bb9" returned: 0 in 0.641s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f527d06b-5ea7-4030-937d-e23b3e676bb9" released by "delete_volume" :: held 1.488s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Created reservations ['d689b497-6ae3-4b7e-b64f-a7d6a316a242', 'ad27ee65-0de5-4dbb-966d-faf4f2951d3a', '29642aed-1a74-4700-9be8-79e53464e8f4', 'de70c4db-db05-4333-9b96-0d22f98444fd'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:18 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:18 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:10:18 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:19 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.643s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:10:19 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-b6d9e089-1990-43b0-8f2c-54920fa984a8 tempest-ProjectMemberTests-119994507 None] Lock "cinder-f527d06b-5ea7-4030-937d-e23b3e676bb9-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (6c9a3858-340b-4409-9e0b-b205515bab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a8cbbc-db31-4ae2-afc5-247e56c38e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a8cbbc-db31-4ae2-afc5-247e56c38e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417700863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62a3387-a50c-4aac-986e-ebfa0ac7d9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:20Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa26ad1-278b-4efa-b10a-c9f9d03bf87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa26ad1-278b-4efa-b10a-c9f9d03bf87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da2f2b3-7ee0-46a6-91dc-8845c9a688f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da2f2b3-7ee0-46a6-91dc-8845c9a688f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62a3387-a50c-4aac-986e-ebfa0ac7d9e1', 'volume_name': 'volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f9aab2-0d94-4282-91fb-21e58b50138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f9aab2-0d94-4282-91fb-21e58b50138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fd3a8a-dfb3-43b6-a3b7-9f5726fd7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:19 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Volume b62a3387-a50c-4aac-986e-ebfa0ac7d9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1', 'volume_size': 1} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417700863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62a3387-a50c-4aac-986e-ebfa0ac7d9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:20Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Creating volume b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:10:19 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:10:19 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:19 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 1073741824 Jul 10 06:10:19 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:20 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 1073741824" returned: 0 in 0.793s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:20 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:20 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 Jul 10 06:10:20 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:21 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" returned: 0 in 0.642s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fd3a8a-dfb3-43b6-a3b7-9f5726fd7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2116c7-7503-4f69-be82-768b3a22d833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:21 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Volume volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 (b62a3387-a50c-4aac-986e-ebfa0ac7d9e1): created successfully Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2116c7-7503-4f69-be82-768b3a22d833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:21 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (6c9a3858-340b-4409-9e0b-b205515bab51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:21 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3ffbf950-0f55-4a34-9e9d-7784af85db22 tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Creating offline snapshot 0d96bc10-fd86-4862-915d-7586b38e3658 of volume b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891f70e-cd1f-43db-8850-9a1c28a11a54]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:22 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 Jul 10 06:10:22 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:22 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" returned: 0 in 0.767s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:22 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:22 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 1G Jul 10 06:10:22 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:23 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 1G" returned: 0 in 0.779s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:23 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:23 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 Jul 10 06:10:23 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:24 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658" returned: 0 in 0.668s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:24 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 is being set with open permissions: ugo+rw Jul 10 06:10:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:24 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 Jul 10 06:10:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:24 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658" returned: 0 in 0.627s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:24 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:24 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info Jul 10 06:10:24 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:25 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info" returned: 0 in 0.673s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:25 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info is being set with open permissions: ugo+rw Jul 10 06:10:25 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:25 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info Jul 10 06:10:25 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:26 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.info" returned: 0 in 0.637s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:26 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.229s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:26 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-13456334-55b8-4b08-b947-03a57090811b tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-0d96bc10-fd86-4862-915d-7586b38e3658-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Lock "cinder-0d96bc10-fd86-4862-915d-7586b38e3658-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-0d96bc10-fd86-4862-915d-7586b38e3658" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-0d96bc10-fd86-4862-915d-7586b38e3658" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot 0d96bc10-fd86-4862-915d-7586b38e3658 of volume b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd093002-16eb-46bc-aa16-7d6e4c3c1d77]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:27 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:27 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 Jul 10 06:10:27 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:28 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658" returned: 0 in 0.738s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[134672e2-cc58-4c83-a8ff-d33d0c4e0de1]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:28 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 Jul 10 06:10:28 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:28 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" returned: 0 in 0.749s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:28 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:28 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:28 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:10:28 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:29 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.654s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:10:29 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:29 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658 Jul 10 06:10:29 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:30 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1.0d96bc10-fd86-4862-915d-7586b38e3658" returned: 0 in 0.622s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-0d96bc10-fd86-4862-915d-7586b38e3658" released by "_delete_snapshot" :: held 2.930s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" released by "delete_snapshot" :: held 2.953s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Created reservations ['cc9db699-19c5-41d8-aee7-6439dc1ae644', '4ea758d9-c58c-4bae-ac45-4fd0d6576102', '6833758b-f317-423a-b404-da678f4094aa', 'a5bf5454-711a-46ee-847a-ebfbf58396ec'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:30 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-f1b823cb-fc40-4f93-8039-0459787ef695 tempest-ProjectMemberTests-119994507 None] Lock "cinder-0d96bc10-fd86-4862-915d-7586b38e3658-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Lock "cinder-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" acquired by "delete_volume" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e386208-897b-4b8f-952b-67d0297015cc]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:30 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:30 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 Jul 10 06:10:30 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:31 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" returned: 0 in 0.746s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:31 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:31 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1 Jul 10 06:10:31 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:32 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" returned: 0 in 0.696s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1" released by "delete_volume" :: held 1.505s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Created reservations ['b4a0c0dd-cb1f-4d13-9507-16b86fa2d85e', 'bd3ba6a6-1e9b-4432-9212-3e4eb513b0bb', '8e6c9d3c-61a9-4218-9769-0f3f55ea1403', '3b1e19de-e91a-47cb-a82e-09aba350079b'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:32 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:10:32 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:32 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.666s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:10:32 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:10:32 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-c22b2e89-2dd4-4461-9ad5-99eddfde5328 tempest-ProjectMemberTests-119994507 None] Lock "cinder-b62a3387-a50c-4aac-986e-ebfa0ac7d9e1-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (57dbddd2-50bd-4dc8-9a44-890dab55f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9ce679-258e-4f9c-ab0b-ab1df66e052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9ce679-258e-4f9c-ab0b-ab1df66e052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602204221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2c7a09-8a5b-436c-8459-2ff04ab42a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:33Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88518765-669c-4585-aadd-4526d40b9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88518765-669c-4585-aadd-4526d40b9b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424f3771-fd67-42cf-9c06-d284104c5b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424f3771-fd67-42cf-9c06-d284104c5b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2c7a09-8a5b-436c-8459-2ff04ab42a50', 'volume_name': 'volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dc81af-96fb-4247-8c44-814a9f8f9017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dc81af-96fb-4247-8c44-814a9f8f9017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ce8b1f-d4e0-43ad-bd71-cb5aed1b2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:33 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Volume 4b2c7a09-8a5b-436c-8459-2ff04ab42a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50', 'volume_size': 1} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602204221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2c7a09-8a5b-436c-8459-2ff04ab42a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:33Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Creating volume 4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:10:33 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:10:33 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:33 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 1073741824 Jul 10 06:10:33 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:34 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 1073741824" returned: 0 in 0.815s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:34 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 Jul 10 06:10:34 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:34 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" returned: 0 in 0.679s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ce8b1f-d4e0-43ad-bd71-cb5aed1b2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a409605-51e8-4659-a552-e01247d284bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:34 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Volume volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 (4b2c7a09-8a5b-436c-8459-2ff04ab42a50): created successfully Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a409605-51e8-4659-a552-e01247d284bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:34 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (57dbddd2-50bd-4dc8-9a44-890dab55f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:34 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4da0119a-504f-4715-983c-8193cf92f1d0 tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:10:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:35 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Creating offline snapshot cf161913-07fd-4787-ae8f-a99825363fcc of volume 4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:10:35 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a913b-fdb4-4661-b4c9-e2b192f264d7]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:35 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:35 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 Jul 10 06:10:35 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:36 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" returned: 0 in 0.788s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:36 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc 1G Jul 10 06:10:36 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:36 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc 1G" returned: 0 in 0.789s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:36 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:36 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc Jul 10 06:10:36 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:37 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc" returned: 0 in 0.684s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:37 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc is being set with open permissions: ugo+rw Jul 10 06:10:37 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:37 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc Jul 10 06:10:37 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:38 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc" returned: 0 in 0.660s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:38 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info Jul 10 06:10:38 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:38 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info" returned: 0 in 0.631s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:38 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info is being set with open permissions: ugo+rw Jul 10 06:10:38 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:38 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info Jul 10 06:10:38 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:39 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.info" returned: 0 in 0.668s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:39 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.299s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:39 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-76b9596f-fd4a-4da8-b1ac-fa193911c0ae tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-cf161913-07fd-4787-ae8f-a99825363fcc-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Lock "cinder-cf161913-07fd-4787-ae8f-a99825363fcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-cf161913-07fd-4787-ae8f-a99825363fcc" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-cf161913-07fd-4787-ae8f-a99825363fcc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot cf161913-07fd-4787-ae8f-a99825363fcc of volume 4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ce6c50-5194-4bfd-9594-240a9a863cc4]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:40 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:40 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc Jul 10 06:10:40 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:41 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc" returned: 0 in 0.768s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:41 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:10:41 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf7bb78-ae5a-4596-a11d-65c520ae2711]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:41 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:41 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 Jul 10 06:10:41 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:42 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" returned: 0 in 0.767s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:42 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc Jul 10 06:10:42 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:42 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc" returned: 0 in 0.741s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:42 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:43 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc Jul 10 06:10:43 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:43 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50.cf161913-07fd-4787-ae8f-a99825363fcc" returned: 0 in 0.692s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-cf161913-07fd-4787-ae8f-a99825363fcc" released by "_delete_snapshot" :: held 3.062s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" released by "delete_snapshot" :: held 3.084s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:DELETE=7,cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=90 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:UPDATE=102,cinder:SELECT=71,cinder:INSERT=29,cinder:DELETE=9 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Created reservations ['17d4ef54-1ba0-4f53-a4d6-d30139428b08', '1acb8870-0dd1-49c7-b5ab-f2a0cfc14278', '02a2203f-17c5-4238-a0db-e31583db672a', '58544242-a9fa-4443-85a3-db2b2574cace'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:43 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:10:43 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-3e6ed64c-42ab-4630-9a1b-31126a1a78c5 tempest-ProjectMemberTests-119994507 None] Lock "cinder-cf161913-07fd-4787-ae8f-a99825363fcc-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-4b2c7a09-8a5b-436c-8459-2ff04ab42a50-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Lock "cinder-4b2c7a09-8a5b-436c-8459-2ff04ab42a50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:44 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" acquired by "delete_volume" :: waited 0.018s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:44 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[37731e7e-abae-486e-8a40-d4882a49ca2a]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:44 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:45 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 Jul 10 06:10:45 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:45 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" returned: 0 in 0.749s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:45 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:45 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50 Jul 10 06:10:45 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:46 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" returned: 0 in 0.718s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-4b2c7a09-8a5b-436c-8459-2ff04ab42a50" released by "delete_volume" :: held 1.521s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Created reservations ['ab51e029-7d08-45b5-88c6-2f0a57edd773', 'ddc896a5-7576-4911-a2b2-554f601d532a', '6020a63f-e46b-49f2-9cf1-41ab895f3a11', '74ef0e2e-a72e-433a-a0a9-8bd58a627a38'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:46 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:46 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:10:46 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:47 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.647s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:10:47 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-23e80e0a-b48b-43f2-95a3-256227d32970 tempest-ProjectMemberTests-119994507 None] Lock "cinder-4b2c7a09-8a5b-436c-8459-2ff04ab42a50-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.flows.manager.create_volume [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87449) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (3f0101bd-dc2b-4d8d-b393-08776a2347ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1702c5-9978-4d6d-875b-87050de268f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1702c5-9978-4d6d-875b-87050de268f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123933205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8220d7c-e280-491b-9d54-8423f705a3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:47Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aa7b2f-5e85-4a26-942f-47a436a94913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aa7b2f-5e85-4a26-942f-47a436a94913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceb1101-9489-45a4-96ad-a417137e528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceb1101-9489-45a4-96ad-a417137e528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8220d7c-e280-491b-9d54-8423f705a3f0', 'volume_name': 'volume-f8220d7c-e280-491b-9d54-8423f705a3f0', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5081134c-d1f1-4331-a143-d85e616162c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5081134c-d1f1-4331-a143-d85e616162c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0925558b-0c28-4670-b12f-d0f099853117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:47 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Volume f8220d7c-e280-491b-9d54-8423f705a3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8220d7c-e280-491b-9d54-8423f705a3f0', 'volume_size': 1} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123933205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8220d7c-e280-491b-9d54-8423f705a3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3853f2a22745fdadb259ec884824e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:10:47Z,use_quota=True,user_id='0e08c9dff5ab45c8956dd27acc5538a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad9e0adb-6ccd-4672-900c-5bdfa4312777),volume_type_id=ad9e0adb-6ccd-4672-900c-5bdfa4312777)}" {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Creating volume f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Selected osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d as target Quobyte volume. {{(pid=87449) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:10:47 devstack cinder-volume[87449]: INFO cinder.volume.drivers.remotefs [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] casted to osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d Jul 10 06:10:47 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 1073741824 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:47 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 1073741824 Jul 10 06:10:47 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:48 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 1073741824" returned: 0 in 0.908s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:48 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:48 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 Jul 10 06:10:48 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:49 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0" returned: 0 in 0.671s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'} {{(pid=87449) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0925558b-0c28-4670-b12f-d0f099853117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8220d7c-e280-491b-9d54-8423f705a3f0', 'volume_size': 1}' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05b9279-bc58-4fb6-afc3-c91b5cd6195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:10:49 devstack cinder-volume[87449]: INFO cinder.volume.flows.manager.create_volume [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Volume volume-f8220d7c-e280-491b-9d54-8423f705a3f0 (f8220d7c-e280-491b-9d54-8423f705a3f0): created successfully Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05b9279-bc58-4fb6-afc3-c91b5cd6195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87449) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Flow 'volume_create_manager' (3f0101bd-dc2b-4d8d-b393-08776a2347ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87449) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:10:49 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-224f2b3e-a66d-4cf6-b5e5-0ac197b8920c tempest-ProjectMemberTests-119994507 None] Created volume successfully. Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Creating offline snapshot b95639e1-2380-458a-9659-7ebf70a09e4d of volume f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5fcdb0-58e2-47f7-b7e7-03ad8b2037a3]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:49 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:49 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 Jul 10 06:10:49 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:50 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0" returned: 0 in 0.730s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:50 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d 1G {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:50 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d 1G Jul 10 06:10:50 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:51 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d 1G" returned: 0 in 0.787s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8220d7c-e280-491b-9d54-8423f705a3f0 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:51 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8220d7c-e280-491b-9d54-8423f705a3f0 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d Jul 10 06:10:51 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:51 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8220d7c-e280-491b-9d54-8423f705a3f0 -F qcow2 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d" returned: 0 in 0.671s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:51 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d is being set with open permissions: ugo+rw Jul 10 06:10:51 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:51 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d Jul 10 06:10:51 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:52 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d" returned: 0 in 0.632s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:52 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:52 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info Jul 10 06:10:52 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:53 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info" returned: 0 in 0.635s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:53 devstack cinder-volume[87449]: WARNING cinder.volume.drivers.remotefs [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info is being set with open permissions: ugo+rw Jul 10 06:10:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:53 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info Jul 10 06:10:53 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:53 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.info" returned: 0 in 0.624s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:53 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.154s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:10:53 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-4796d491-1559-4abb-b6e8-52dc53520801 tempest-ProjectMemberTests-119994507 None] Create snapshot completed successfully Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-b95639e1-2380-458a-9659-7ebf70a09e4d-delete_snapshot" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Lock "cinder-b95639e1-2380-458a-9659-7ebf70a09e4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-f8220d7c-e280-491b-9d54-8423f705a3f0" by "delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f8220d7c-e280-491b-9d54-8423f705a3f0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-b95639e1-2380-458a-9659-7ebf70a09e4d" by "_delete_snapshot" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-b95639e1-2380-458a-9659-7ebf70a09e4d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Deleting offline snapshot b95639e1-2380-458a-9659-7ebf70a09e4d of volume f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] snapshot_file for this snap is: volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d {{(pid=87449) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acd5ffe-f7cf-4257-972c-edc2fc33d18d]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:55 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d Jul 10 06:10:55 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:55 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d" returned: 0 in 0.772s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.remotefs [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8220d7c-e280-491b-9d54-8423f705a3f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87449) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950bb8f-4f8a-4b19-9199-09d26189cb37]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:55 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:56 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 Jul 10 06:10:56 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:56 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0" returned: 0 in 0.786s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:56 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:56 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d Jul 10 06:10:56 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:57 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d" returned: 0 in 0.728s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:57 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:57 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d Jul 10 06:10:57 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:10:58 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 10 06:10:58 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0.b95639e1-2380-458a-9659-7ebf70a09e4d" returned: 0 in 0.659s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:10:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-b95639e1-2380-458a-9659-7ebf70a09e4d" released by "_delete_snapshot" :: held 3.035s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f8220d7c-e280-491b-9d54-8423f705a3f0" released by "delete_snapshot" :: held 3.060s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:58 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Created reservations ['76083716-66eb-4080-8a3e-bb144ddc35c5', '55a9007f-fd41-4c7f-bce3-eab58c25ac5b', '6c49901d-bcdd-4614-aa8e-9f1b7ce3c2a6', 'd7205327-a6b6-4064-b10e-a447ad7f9ac3'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:10:58 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Delete snapshot completed successfully. Jul 10 06:10:58 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-25eb9b0b-8c92-4827-8003-6cb62d64dcd4 tempest-ProjectMemberTests-119994507 None] Lock "cinder-b95639e1-2380-458a-9659-7ebf70a09e4d-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:10:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-f8220d7c-e280-491b-9d54-8423f705a3f0-delete_volume" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Lock "cinder-f8220d7c-e280-491b-9d54-8423f705a3f0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Acquiring lock "cinder-quobyte-f8220d7c-e280-491b-9d54-8423f705a3f0" by "delete_volume" {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:10:59 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f8220d7c-e280-491b-9d54-8423f705a3f0" acquired by "delete_volume" :: waited 0.014s {{(pid=87449) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:10:59 devstack cinder-volume[87449]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e397c5-33d8-49f3-aaad-b796ce68a9d8]: (4, 'qcow2') {{(pid=88449) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:10:59 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:10:59 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 Jul 10 06:10:59 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:11:00 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0" returned: 0 in 0.727s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:11:00 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0 Jul 10 06:11:00 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:11:00 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7/volume-f8220d7c-e280-491b-9d54-8423f705a3f0" returned: 0 in 0.626s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Lock "cinder-quobyte-f8220d7c-e280-491b-9d54-8423f705a3f0" released by "delete_volume" :: held 1.408s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG cinder.quota [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Created reservations ['c7049062-38db-4e1f-ba1d-8cc6901c969a', '7523fdf5-6e4e-4956-af03-d4f2ccc07ca4', '5bae5704-58b8-4d04-9059-88ec0c478deb', '335c97b1-f417-4c78-b523-f2777f845ae1'] {{(pid=87449) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:11:00 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:11:00 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:11:00 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:11:01 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 10 06:11:01 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.633s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:11:01 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:11:01 devstack cinder-volume[87449]: INFO cinder.volume.manager [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Deleted volume successfully. Jul 10 06:11:01 devstack cinder-volume[87449]: DEBUG cinder.coordination [None req-971622e6-66c1-4c0a-87f8-589e92cecfa3 tempest-ProjectMemberTests-119994507 None] Lock "cinder-f8220d7c-e280-491b-9d54-8423f705a3f0-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87449) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:11:10 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:INSERT=8,cinder:UPDATE=32,cinder:SELECT=17,cinder:DELETE=1 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:11:11 devstack cinder-volume[87449]: DEBUG dbcounter [-] [87449] Writing DB stats cinder:SELECT=29,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=87449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d': None} {{(pid=87449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-522cac33-b9d9-4516-b8bf-20114793503d'] {{(pid=87449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.lockutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:11:28 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:11:28 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7 Jul 10 06:11:28 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:11:29 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 06:11:29 devstack cinder-volume[87449]: DEBUG oslo_concurrency.processutils [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/929a4647f6edb214c8a11ea209ac9fe7" returned: 0 in 0.649s {{(pid=87449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:11:29 devstack cinder-volume[87449]: DEBUG cinder.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Notifying Schedulers of capabilities ... {{(pid=87449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:11:29 devstack cinder-volume[87449]: DEBUG oslo_service.periodic_task [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] Running periodic task VolumeManager._thread_info {{(pid=87449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:11:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread count: 8 {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:11:29 devstack cinder-volume[87449]: DEBUG cinder.volume.manager [None req-aaeb17bf-7da8-432c-ba2a-43c1065c7b76 None None] thread info: [<_MainThread(MainThread, started 135036098437248)>, , , , , , , ] {{(pid=87449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}